AD.4063162 


i. 


A FRAMEWORK  FOR  POLICY-LEVEL 
logistics  MANAGEMENT  . 

I 


Voliunejm/A  Macro  Analysis  of 
/*  DoD  Logistics  Systems  > 

1 \j  ! 


/December  1978 


' Hurray  A./Geisler- 
Mary  J./Hutzle^, 
Robert  D. /Kaiser 
Laurence  D. /Richards 


D o c 

1 10  m Ijjj 

J li  : I 


Prepared  pursuant  to  Department  of  Defense 
Contract  No.  HDA903-77-C0370  (Task  ML606(3l). 
Views  or  conclusions  contained  in  this 
document  should  not  be  interpreted  as 
representing  official  opinion  or  policy  of 
the  Department  of  Defense.  Except  for  use 
for  Government  purposes,  permission  to  quote 
from  or  reproduce  portions  of  this  document 
must  be  obtained  from  the  Logistics 
Management  Institute. 


I 

I 

J 

3 

■1 

i 


LOGISTICS  MANAGEMENT  INSTITUTE 


PREFACE 


This  report  is  the  final  volume  of  a three-volume  study  entitled  "A  Macro 
Analysis  of  DoD  Logistics  Systems",  initiated  in  July  1976  by  the  Assistant 
Secretary  of  Defense  (Installations  and  Logistics).  The  intent  of  the  study 
was  to  examine  DoD  logistics  from  a macro  point  of  view  so  as  to  understand 
OSD's  policy  role  and  provide  useful  tools  for  exercising  it.  Volume  I, 
Logistics  Systems  in  the  Department  of  Defense , describes  the  Services' 
logistics  systems,  their  organizational  structures,  management  practices,  and 
accounting,  budgeting  and  reporting  systems.  Volume  II,  Structure  and 
Analysis  of  the  Air  Force  Logisti .~s  System,  presents  the  results  of  a thorough 
search  for  aggregate  indicators  of  performance,  productivity  and  readiness 
that  could  provide  a macro  overview  of  the  Air  Force  logistics  system.  This 
report,  Volume  III,  addresses  the  problems  of  analyzing,  interpreting  and 
augmenting  aggregate  management  indicators.  The  result  is  a conceptual 
framework  that  places  those  indicators  in  the  context  of  the  policy-level 
management  role. 

We  use  the  word  "framework"  to  refer  to  an  abstract  structure  for  think- 
ing through  policy-Irvel  management  problems.  This  structure  raises  method- 
ological questions  about  the  ini'ormation  and  analytical  needs  of  policy 
i);:',nagement . Our  intent  is  to  stimulate  discussion  of  some  very  complex 
conceptual  issues.  We  believe  that  the  work  presented  here  represents  the 
state  of  the  art  in  quantitative  analysis,  modeling  methodology,  and  manage- 
ment processes  as  applied  to  policy-making  and  long-range  planning  in  DoD. 
implementation  of  the  framework  could  take  numerous  forms,  each  of  which  would 
require  some  further  research. 


Many  individuals  within  LMI  and  DoD  have  offered  useful  comments  and 
insights  throughout  this  study.  It  would  be  impossible  to  list  all  of  them, 
but  we  would  like  to  acknowledge  the  constructive  criticism  and  encouragement 
of  four  in  particular:  Mr.  Everett  Pyatt,  now  Principal  Deputy  Assistant 
Secretary  of  the  Navy  for  Logistics;  Mr.  Oscar  Goldfarb,  Deputy  for  Supply  and 
Maintenance  in  the  Office  of  the  Deputy  Assistant  Secretary  of  the  Air  Force 
for  Logistics;  Mr.  Hugh  McCullough  and  Dr.  John  Bennett,  both  former  Principal 
Deputy  Assistant  Secretaries  of  Defense  for  Installations  and  Logistics,  who 
have  experienced  the  problems  of  policy-level  management  first-hand.  However, 
we  assume  full  responsibility  for  the  content  of  this  report. 
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I . INTRODUCTION 


OSD  LOGISTICS  NANGEMENT  ROLF. 

The  Office  of  the  Secretary  of  Defense  (OSD)  has  overall  management 
responsibility  for  the  DcD.  The  magnitude  of  this  responsibility  can  be 
gauged  by  such  impressive  statistics  as  an  annual  budget  in  excess  of 
125  billion  dollars,  A. 5 million  military  and  civilian  employees, 
20,000  complex  military  aircraft,  and  over  500  major  installations. 

To  facilitate  the  management  task,  such  a large  establisliment  must  be 
broken  down  into  smaller  segments.  Thu.s,  the  DoD  is  divided  into  three  large 
Military  Departments,  each  of  which  is  responsible  for  an  almost  equal  share 
of  the  defense  budget.  However,  OSD  retains  full  responsibility  and  authority 
for  all  resources  assigned  to  DoD. 

We  have  chosen  to  view  the  Secretary  of  Defense  as  the  chairman  or  Chief 
Executive  Officer  of  a large,  integrated  organization,  and  OSD  as  the  Office 
of  the  Chairman.  The  Military  Departments  then  represent  three  major  oper- 
ating divisions  of  the  organization.  In  this  sense,  OSD  is  policy-le'  '1  man- 
agement, and  the  Military  Departments  are  operational-level  management.  OSD's 
role  is  essentially  policy  formulation,  resource  allocation  and  performance 
monitoring  for  the  entire  Defense  Department.  This  report  analyzes  the  needs 
of  DoD  policy-level  management  and  develops  a framework  for  identifying 
management  tools  useful  at  this  level. 

The  Need  for  Aggregate  Information 

Given  the  size  and  complexity  of  '".D,  neither  the  Secretary  of 


1-1 


Defense  nor  his  staff  can  become  involved  in  all,  or  even  many,  of  its  oper- 
ational details.  Still,  the  Secretary  must  have  an  informed  perspective  on 
uhat  is  occtirring  so  that  he  can  exercise  his  authority  to  ensure  that  the 
Goveriiraent' s defense  objectives  are  being  achieved.  The  OSD  st.aff  can  provide 
such  a perspective,  but  the  basic  information  must  come  from  the  Military 
Departments . 

OSD  must  therefore  be  able  to  specify  the  type  of  information  most 
helpful  to  the  Secretary.  There  is  a particular  need  at  the  policy  level  for 
information  related  to  the  allocation  of  resources--to  support  budget  requests 
submitted  to  the  President  and  Congress,  to  apportion  appropriated  funds,  to 
approve  major  resource  or  fund  commitments,  and  to  evaluate  the  defense 
capability  being  achieved.  The  Secretary  also  needs  information  to  set  DoD 
objectives  and  develop  policy  consistent  with  them. 

At  the  same  time,  the  Secretary  is  necessarily  limited  as  to  the 
kind  and  amount  of  information  he  can  effectively  use.  lie  does  not  have  the 
time  tf)  review  and  digest  detailed  reports.  Because  the  defense  structure  is 
so  complex,  he  cannot  possibly  consider  all  the  ramifications  of  every  issue. 
At  the  policy  level,  highly  aggregate  information  is  needed  to  maintain  visi- 
bility over  the  operational  system  and  to  support  policy  and  resource  analysis 
and  decision-making. 

Such  information  cannot  be  a simple  accumulation  of  information  from 
the  operational  levels.  What  is  provided  to  policy-level  management  must  be 
tailored  to  its  purposes,  selectively  aggregated,  and  carefully  analyzed.  The 
relationships  among  resources,  performance,  and  policies  must  be  clarified  so 
that  OSD  management  will  be  able  to  decide  how  best  to  achieve  its  objective 
of  overall  defense  capability. 
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Relating  Input  to  Output 


Various  efforts  have  been  made  to  develop  a better  understanding  of 
how  to  relate  defense  output,  as  represented  by  measurements  of  eapability  to 
defense  input,  as  represented  by  Logistics  resources  ami  policies.  .it  the 

policy  level,  output  needs  to  be  defined  in  highly  aggregate  terms.  But  the 
process  of  aggregation  is  complicated  by  problems  in  both  definition  and 
measurement . 

There  are  numerous  reporting  systems  in  DoD  that  describe  output  at 
the  aggregate  level,  For  example,  the  FORSTAT  reporting  system  is  intended  to 
describe  the  capability  of  individual  units  in  highly  aggregate  and  judgmental 
terms.  Other  reporting  systems  measure  the  readiness  or  availability  status 
of  individual  weapon  systems  at  the  unit  level  and  indicate  to  what  extent 
shortages  in  logistics  resources  affect  weapon  system  status.  Many  of  the 
existing  systems  can  be  aggregated  for  OSD  use,  and  they  do  depict  defense 
capability.  However,  such  aggregate  reporting  of  output  does  not  give 
policy-level  managers  all  the  information  they  need. 

Input  such  as  manpower,  equipment,  and  spare  parts  is  reported  and 
managed  within  the  Services;  various  reporting  activities  supply  OSD  with  this 
kind  of  aggregate  information.  These  reports  show  overall  gains  and  losses, 
usually  In  terms  of  dollars.  Such  reports  are  useful  for  budget  and  cost 
analysis,  and  efforts  to  determine  the  costs  of  particular  activities,  such  as 
base-level  operations  and  depot  maintenance  production  continue.  But  again, 
information  on  input  alone  cannot  satisfy  all  the  needs  of  policy-level 
management . 

The  FORSTAT  reporting  system  is  described  in  JCS  Publication  b, 
Volume  II. 
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The  policy-level  manager's  responsibility  for  resource  allocation, 
policy  analyses,  and  planning  requires  a reasonable  understanding  of  the  re- 
lationships between  defense  input  and  output.  TechnL(|ues  for  under.standing 
these  relationships  are  already  use<l  at  various  levels  of  ()perational  managi'- 
ment.  for  example,  there  are  techniques  for  determining  spare  parts  require- 
ments consistent  with  specified  supply  performance  goals,  as  measured  by 
expected  backorder  rates.  Similarly,  manpower  requirements  are  being  computed 
by  simulation  techniques  relating  aircraft  operations  to  maintenance.  Thus, 
the  necessary  relationships  between  input  and  output  are  being  developed  and 
used  within  specific  functional  or  resource  areas.  Our  concern  is  how  to 
apply  this  knowledge  at  the  OSD  level. 

The  solution  is  not  simply  to  aggregate  details;  the  process  would 
be  too  time-consuming  and  still  would  not  produce  sufficiently  aggregate  in- 
formation. The  relationships  themselves  must  be  specified  in  aggregate  terms. 
I’hus,  output  must  consist  of  broad  measures  of  defense  capability  reflecting 
the  status  of  combat  organizations  and  supporting  activities,  anil  must  be 
expressed  in  terms  appropriate  for  decision-making  at  the  OSD  level.  This  is 
because  policy-level  management  has  to  work  with  .ipproxiinations  of  current 
status  in  order  to  formulate  broad  operational  guidance. 

Policy-level  management  in  DoD  is  affected  not  only  by  its  .approxi- 
mate perception  of  the  input-output  relationships,  hut  also  by  the  complexity 
of  the  output  itself,  which  is  expressed  in  terms  of  "re.iili  ness" , "av.iila- 
bility",  or  "capability".  These  .ire  general  terms,  but  when  speciticaLlv 
defined,  they  take  on  specialized  ine.inings  and  are  tlunefore  no  longer  tne 
mea.surt’s  of  overall  defense  cap.abilLty  of  concern  to  pu  I i cy- 1 eve  1 inan.igement . 

One  approach  u.sed  by  DoD  to  overcome  this  difficulty  h.is  been  to  use 
detailed  measures  as  proxies  for  logistics  system  performance.  Thus,  sup|)Ly 
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fill  rates,  maintenaiice  man-hours  per  flying  hour,  or  mean  time  between 
failures  have  been  used  as  measures  of  logistics  system  capability.  However, 
it  is  difficult  to  translate  such  detailed  statistics  into  meaningful  indi- 
cators of  defense  capability,  because  the  relationships  between  these  two  sets 
of  variables  are  imperfectly  understood.  Furthermore,  volume  II  of  this 
series  demonstrated  the  difficulty  of  tracing  such  relationships  and  inter- 
preting the  measures  used  in  the  Air  Force. ^ Nonetheless,  these  detailed 
statistics  reflect  the  current  state  of  the  art  in  capability  assessment;  a 
good  example  it  the  Air  Force  Quarterly  World-wid*  Logistics  Report.  This 
report  has  been  designed  for  the  major  Air  Force  commands  to  use  in  assessing 
their  wartime  support  capability  and  to  help  Air  Force  headquarters  to  deter- 
mine how  it  might  assist  its  major  commands. 

In  other  instances,  output  measures  such  as  aircraft  availability, 
defined  in  specialized  terras,  have  been  used  to  evaluate  the  impact  of  air- 
craft spares  expenditures  and  stockage  policy.  But  because  su'h  applications 
usually  reflect  only  parts  of  overall  defense  capability,  the  results  can 
offer  only  a limited  perspective  to  policy-level  management.  Considerable 
judgment  is  necessary  to  integrate  such  partial  determinations  of  defense 
capability  into  a complete  picture  of  input  in  relation  to  output. 

The  problems  of  defining  output  measures  reflecting  defease  capa- 
bility and  relating  them  precisely  to  input  measures  representing  resources 
■and  policies  necessarily  mean  that  any  cause-and-ef feet  structure  will  have  to 
be  based  on  approximations.  Furthermore,  such  a structure  must  produce 
information  con.sistent  with  our  concept  of  the  OSD  policy  management  role. 
The  tools  described  in  this  report  are  consistent  with  these  views;  they  can 
be  used  on  highly  aggregate  but  carefully  struccured  data  to  tie  broad  output 
measures  to  resource  and  policy  input. 
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MANAGEMENT  INDICATORS 


This  study  was  initially  designed  to  investigate  what  indicators  might  be 
available  for  use  at  the  policy  level  of  logistics  management.  This  section 
describes  our  early  efforts  to  understand  the  use  of  management  indicators 
within  the  OoO  and  our  evaluation  of  the  principal  management  indicator  system 
developed  for  OSD.  It  also  summarizes  our  prior  work  in  the  task. 

The  traditional  role  of  indicators  in  DoD  logistics  has  been  to: 

- Assess  overall  logistics  systems  performance  against  some  set  of  goals 
and  standards 

- Provide  early  knowledge  of  significant  changes  in  system  performance, 
i.e.,  detect  and  correct  errors 

* Improve  communications  between  OSD,  0MB,  and  Congress;  between  OSD  and 
the  Military  Services;  and  within  OSD. 

But  despite  the  elaborate  accounting  and  reporting  systems  that  were  de'-eloped 
to  support  such  indicators,  a systematic  process  for  determining  the  degree  to 
which  logistics  factors  influence  both  logistics  and  operational  performance 
has  been  lacking. 

LPMES 

The  most  recent  and  perhaps  best  example  of  an  OSD  management  indi- 
cator  system  was  the  Logistics  Performance  Measurement  and  Evaluation  System 
(LPMES).  LPMES  was  u quarterly  report  of  the  status  of  key  logistics  func- 
tions relative  to  specified  goals  and  standards.  Initiated  in  1969,  LPMES  was 
eventually  suspended  ir  1976  because  of  general  dissatisfaction  with  its  re- 
sults. Having  reviewed  the  concept  and  performance  of  LPMES,  we  feel  that 
there  are  three  principal  reasons  that  could  account  for  dissatisfaction  with 
its  usefulness  at  the  OSD  level. 

First,  LPMES  had  a limited  structure  along  functional  lines.  The 
indicators  were  selected  by  functional  managers  for  relevance  to  a particular 
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function,  and  not  necessarily  to  fit  into  an  overall  representation  of  logis- 
tics capability  (see  Table  1).  The  result  was  that  LPIIES  lacked  the  kind  of 
systemwide  perspective  on  DoD  logistics  performance  that  would  be  desired  by 
the  Assistant  Secretary  of  Defense  (Manpower,  Reserve  Affairs  and  Logistics) 
(ASD(MRA&L)). 

TABLE  1.  INDICATORS  USED  IN  LPMES 


Materiel  Obligations  Outstanding 
Minimize  Wholesale  Item  Range 
On-Time  Pipeline  Performance 
Item  Identification  Improvement 
Utilization  of  Long  Supply,  Excess  and 
Surplus  Property 
Stock  Availability 

Letter  Contracts 

Undef initized  Change  Orders 

Competition 

Small  Business 

Progress  Payments 

Containerization 

Maintenance  Capital  Investment 
Maintenance  Manhours  Per  flying  Hour 
Aircraft  Engine  Mean  Time  Between  Overhaul 
Modification  Management 
Depot  Maintenance  Production  Cost  and 
Performance 
Maintenance  Manpower 
Depot  Maintenance  Workload  Program 

Class  I Value  Engineering  Change  Proposals 
(VECPs)  Received 
Delays  in  Ship  Deliveries 

Second,  the  imposed  goals  used  to  evaluate  each  indicator  were  also 
selected  for  pertinence  to  a particular  function,  and  not  necessarily  for 
their  relationship  to  other  indicators.  This  suggests  that  the  indicators 
were  oriented  to  detailed  operational  management  rather  than  to  policy-level 
needs.  The  environment  of  military  logistics  is  a dynamic  one  and  calls  for 
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flexible  management  response.  The  goals  set  by  policy  managers  must  be  con- 
sistent with  such  an  environment.  The  precise  goals  imposed  by  GS’J  cr  oper- 
ational management  through  LPMES  were  not. 

Third,  the  LPHES  reports  were  not  current  by  OSD  standards.  By  the 
time  the  quarterly  reports  were  published  and  distributed,  the  information  was 
from  three  to  six  months  old.  OSD  management  was  reluctant  to  work  with  oper- 
ational data  it  considered  out  of  date.  For  much  of  the  data  represented, 
this  ]ack  of  timeliness  was  a serious  deficiency  in  LPMES. 

Although  there  was  some  staff  satisfaction  with  LPMES,  particularly 
from  those  segments  concerned  with  stressing  an  operational  management  focus 
fcr  OSD,  ASDiMRA^’L) ' s general  dissatisfaction  with  the  system  led  eventually 
to  the  request  that  LMI  investigate  performance  measures  and  indicators  more 
appropriate  to  OSD's  logistics  management  role. 

An  Air  Force  Example 

Our  initial  response  to  that  request  was  Phase  1 of  this  study,  a 

description  of  significant  management  aspects  of  the  current  DoD  logistics 
2 

system.  Phase  2 explored  the  Air  Force  logistics  system  as  a test  bed  for 

3 

examining  and  developing  management  indicators.  The  primary  focus  in  Phase  2 
was  the  interactions  between  aircraft  operational  readiness  and  logistics 
system  performance,  and  we  relied  heavily  on  "structural"  and  trend  analysis. 

By  structural  analysis,  we  meant  a formal  method  for  defining  the 
logistics  system  in  graphic  terms  that  couid  potentially  be  subjected  to 
systematic  and  quantitative  analysis.  Our  reliance  on  structural  analysis  was 
based  on  the  conviction  that  it  was  an  appropriate  technique  for  depicting  and 
understanding  the  basic  relationships  of  functional  activities  (.supply, 
maintenance,  transportation,  installations  and  housing,  etc.),  organizational 
levels  (base,  depot,  etc.),  and  management  responsibilities. 
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Figure  1 served  as  a departure  point  for  our  structural  analysis. 
The  figure  represents  the  most  macro  structure  we  could  devise,  and  it  pro- 
vided the  investigation  with  a systemwide  perspective.  Il  also  served  the 
important  function  of  tying  resources  (the  logistics  support  cycle)  to  output 
(the  operational  cycle),  in  terras  of  number  of  sorties  or  operationally  ready 
aircraft.  When  examined  at  a finer  level  of  detail,  this  representation  of 
the  Air  Force  logistics  system  aided  our  initial  investigation  of  relation- 
ships between  variables.  It  was  used  to  guide  data  collection,  develop 
hypotheses  about  cause-and-effect  relationships,  and  select  indicators 
relating  inputs  like  maintenance  man-hours  to  outputs  like  flying  hours. 

The  results  of  the  structural  analysis  were  combined  with  the  tech- 
niques of  trend  analysis  in  our  statistical  examination  of  the  data.  Trend 
analysis  was  used  first  to  identify  changes  over  time  in  significant  logistics 
variables,  such  as  Operationally  Ready  (OR)  rates,  Not  Operationally  Ready, 
Supply  (NORS)  incidents.  Not  Repairable  This  Station  (NRTS)  rates,  etc.  Next, 
we  examined  and  aggregated  input  and  output  data  from  various  Air  Force 
reporting  systems,  cutting  across  several  functional  areas,  and  attempted  to 
relate  observed  changes  in  one  variable  over  time  to  expected  changes  in  re- 
lated variables  with  or  without  time  lags.  The  structural  analysis  helped  to 
guide  the  selection  of  related  variables. 

There  were  two  advantages  to  this  approach.  The  combined  use  of 
structural  and  trend  analysis  produced  a quick  overview  of  the  Air  Force 
Logistics  system.  It  also  provided  revealing  insights  into  the  historical 
movements  of  major  logistics  system  performance  measures  and  resource  trends. 
However,  trends  can  be  misinterpreted  as  a result  of  aggregation  and 
oversimplification.  Further,  it  was  difficult  to  establish  statistically 
significant  cause-and-ef feet  relationships  with  trend  analysis. 
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We  found  that  the  Air  Force  data  systems  were  generally  quite 
satisfactory  in  the  coverage  and  accuracy  required  by  this  type  of  aggregate 
analysis . 

Straightforward  identification  of  cause-and-ef feet  relationships 
would  help  make  the  determination  of  an  appropriate  management  indicator 
system  much  simpler.  The  dynamic  and  complex  nature  of  logistic  system  re- 
lationships, however,  requires  a different  perspective  on  the  use  of  manage- 
ment indicators,  specifically,  that  the  indicators  used  will  change  depending 
on  the  issues  being  faced  by  policy-level  management. 

The  problems  associated  with  discerning  cause  and  effect,  from  trend 
analysis  can  be  illustrated  with  an  example  from  volume  II.  Figure  2 shows 
the  OR,  NORS,  and  Not  Operationally  Ready,  Maintenance  (NORM),  rates  for  all 
Air  Force  aircraft  from  FY  1970  through  FY  1976.”*^  Note  that  the  OR  rate  in 
1972  was  about  70  percent.  The  most  obvious  trend  is  a steady  decrease  in  the 
OR  rate  and  a corresponding  increase  in  the  NORM  rate  over  the  whole  period, 
while  the  NORS  rate  remains  relatively  unchanged.  Are  these  trends  truly 
indicative  of  a reduced  operational  capability?  At  least  four  factors  may  be 
at  work. 

The  first  is  what  we  term  the  "masking”  of  the  .NORS  rate  by  the  NORM 
rate,  i.e.,  an  aircraft  cannot  be  reported  as  NORS  if  it  is  awaiting  or  in 
maintenance,  even  though  it  may  have  a spare  parts  deficiency.  Hence,  when- 
ever an  aiicra?t  requires  both  a replacement  part  and  additional  maintenance, 
it  is  reported  as  NORM,  not  NORS.  The  probable  effect  of  this  masking  is  to 
understate  the  true  NORS  rate. 

X 

The  terras  NORM,  NORS,  and  OR  are  no  longer  used  in  reporting  weapon 
system  readiness.  As  of  November  30,  1977,  other  terminology  has  been  intro- 
duced, but  the  concepts  involved  are  largely  the  same. 
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The  second  factor  is  a change  in  NORM  reporting  as  of  October  1<573. 
At  that  tine,  the  Air  Force  introduced  two  categories  of  NORM:  NORM-F 
(flyable)  and  NORM-G  (grounded).  Although  the  definition  of  NORM  did  not 
change,  the  NORS  plus  NOi^  rate  increased  sharply  in  FY  1974.  it  is  possible 
that  this  modification  in  reporting,  which  made  the  need  to  better  identify 
NORM  aircraft  more  critical,  contributed  significantly  to  that  rise. 

A third  factor  is  that  from  FY  1970  through  FY  1973  the  Air  Force 
phased  out  the  Century  series  of  fighters  and  some  older  cargo  aircraft;  these 
aircraft  typically  exhibited  high  OR  rates.  Concurrently,  new  aircraft,  such 
as  the  F-111  and  C-.^,  were  introduced  into  the  inventory.  These  aircraft  have 
since  experienced  signficantly  lower  OR  rates. 

Finally,  the  latter  part  of  the  FY  1970  through  FY  1976  period  co- 
incided with  the  termination  of  U.S.  participation  in  the  Viet  Nam  conflict. 
Thus,  the  amount  of  aircraft  usage  decreased. 

It  appears,  then,  that  a conclusion  about  the  tendency  in  oper- 
ational capability  based  solely  upon  examination  of  OR,  NORS,  and  NORM  trends 
could  be  misleading.  Additional  knowledge  i.s  needed  to  sharpen  our  ability  to 
examine  relationships  and  trends. 

The  supply  area  offers  another  example  of  the  problems  of  using  and 
interpreting  aggregate  indicators.  While  the  NORS  rate  remained  fairly  con- 
stant during  FY  1970  through  FY  1976,  we  also  found  that  an  associated  measure 
of  supply  performance,  the  NORS  incident-hour  rate,  was  increasing  signifi- 
cantly. Thus,  we  have  inconsistent  indications  of  supply  performance  from  two 
relevant  indicators  from  two  different  data  reporting  systems. 

We  sought  to  explore  the  reasons  behind  the  roughly  constant  NORS 
rate  and  the  rising  NORS  incident-hour  rate,  i.e.,  the  ratio  of  NORS 
incident-hours  to  aircraft  possessed  hours.  A NORS  incident  occurs  whenever  a 
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pact  fails  and,  at  the  same  time,  the  aircraft  is  in  a NORS  condition.  NORS 
incident-hours  accrue  from  the  submission  of  a NORS  requisition  until  termina- 
tion of  the  NORS  incident  condition.  The  two  rates  are  displayed  in  Figure  3. 

The  figure  shows  that  the  NORS  xncident-hour  rate  has  risen  sharply, 
in  contrast  to  the  NORS  rate.  There  are  several  possible  reasons  why  these 
rates  do  not  coincide.  The  most  apparent  is  that  multiple  NORS  incidents  can 
and  do  occur  on  a NORS  aircraft.  Thus,  the  increasing  NORS  incident-hour  rate 
relative  to  the  NORS  rate  could  be  reflecting  a tendency  toward  more  NORS 
incidents  per  aircraft  over  time.  Another  reason  could  be  the  masking  of  NORS 
conditions  by  reporting  the  aircraft  NORM.  There  is  a tendency  to  reclassify 
an  aircraft  as  NORM  after  it  has  been  declared  NORS.  In  such  cases,  the  NORS 
incident-hours  accrue  until  the  incident  is  terminated.  Another  explanation 
could  be  the  use  of  cannibalization  to  consolidate  separate  NORS  incidents 
onto  a single  aircraft.  This  situation  is  akin  to  the  multiple  occurrence  of 
NORS  incidents  on  a single  aircraft,  since  each  NORS  incident  contributes  to 
the  NORS  incident  hours.  The  NORS  incident  data  do  show  a slight  increase  in 
the  use  of  cannibalization  to  terminate  NORS  incidents,  which  would  support 
our  interpretation  of  this  trend  effect. 

We  also  observed  other  Air  Force  behavior  on  terminating  NORS  that 
would  tend  to  restrain  the  NORS  rate,  specifically  the  greater  use  of  War 
Reserve  Materiel  (WRM)  to  terminate  NORS  incidents  (Figure  4).  WRM  usage 
terminates  a NORS  condition,  thus  stopping  further  NORS  aircraft  hours  but  not 
necessarily  NORS  incident  hours.  However,  it  is  clear  that  such  use  of  WTIM 
does  have  some  effect  on  emergency  capability,  and  that,  unless  top  management 
is  aware  of  this  practice,  it  can  misinterpret  overall  capability.  Here 
again,  we  see  the  complicated  analysis  necessary  to  interpret  apparently 
obvious  logistics  system  trends. 
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As  a result  of  the  Air  Force  analysis,  we  felt  it  necessary  to  build 
upon  structural  and  trend  analysis  by  developing  a deeper  understanding  of  the 
relationships  between  variables,  not  only  drawing  upon  quantitative  analysis 
of  the  type  we  first  used,  but  also  by  expanding  the  opportunity  to  use  less 
formal  and  more  qualitative  knowledge,  what  we  will  later  refer  to  as 
"institutional  knowledge."  To  accomplish  this,  the  details  of  the  management 
processes  had  to  be  explored  and  a conceptual  model  of  mauagement  functions 
built.  This  model  served  to  distinguish  the  needs  of  policy-level  management 
from  those  of  operational  management.  Those  needs  were  translated  into  guide- 
lines for  selecting  management  tools. 

GUIDELINES 

The  two  criteria  we  used  in  developing  policy-level  management  tools  were 
that  they  should  use  aggregate  information  and  maintain  a systemwide  per- 
spective. In  addition,  the  tools  selected  for  discussion  exhibit  the 
following  characteristics; 

- While  it  would  be  desirable  to  quantify  cause  and  effect,  it  may  be 
impossible  to  do  so  directly,  the  setting  of  broad  bounds  on  the 
system  may  well  be  the  best  we  can  do,  utilizing  approximations  and 
estimates  of  variables.  Even  so,  we  believe  such  a viewpoint  is 
compatible  with  the  role  of  policy-level  management  in  the  setting  of 
broad  guidelines. 

- All  too  frequently,  top  managers  view  analytical  techniques  as  the 
special  province  of  technical  specialists,  to  be  used  in  behalf  of 
management.  The  tools  we  discuss  in  this  report  should  be  applied  by 
policy-level  management  as  part  of  the  planning  and  policy-making  pro- 
cess done  at  chat  level,  if  their  use  is  to  be  effective. 

- Finally,  the  management  tools  reviewed  here  require  that  their  users 
take  as  much  advantage  as  possible  of  the  institutional  knowledge  of 
logistics  managers  throughout  DoD. 

Using  these  criteria,  our  objective  is  to  formulate  a framework  that  will 
identify  specific  management  tools  in  a functional  interrelationship  so  they 
may  be  readily  recognized  by  top-level  managers  as  adaptable  to  management 


processes  involving  heavy  reliance  on  intuition  and  judgment.  Our  approach  is 
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three-fold:  first,  to  define  the  structural  nature  of  the  management  process; 
second,  to  determine  some  concepts  that  explain  the  functioning  of  that  pro- 
cess; and,  finally,  to  investigate  what  tools  are  available  and  needed,  and 
offer  some  examples  of  how  such  techniques  can  perform  together  coherently  and 
methodically. 

Our  approach  in  this  volume  is  inevitably  more  abstract  than  in  the 
previous  ones,  since  we  are  no  longer  addressing  problems  on  a simple 
technical  plane.  We  will  therefore  attempt  to  maintain  as  much  cousistency  as 
possible  in  the  definition  and  use  of  those  abstractions. 


2.  MAJJAGEMENT  SYSTEM  CONCEPfS 


In  this  chapter,  we  discuss  the  management  systam  < incepts  and  approaches 
used  in  Phase  3 of  this  task.  We  begin  with  a description  of  the  different 
maaagement  processes  that  must  be  carried  out  at  the  various  levels  of  DoD  and 
then  consider  how  our  technical  contribution  can  as':ist  OSD  in  performing  its 
management  functions. 

THE  POD  MANAGEMENT  PROCESS 

Figure  5 identifies  the  basic  activities  of  the  LoD  management  process  as 
we  have  visualized  them  for  this  study.  There  are  three  major  management 
acti.vities : top-level  (institutional)  management,  operatirnal  (technical) 
management,  and  the  management  information  system. 

The  major  distinction  betwean  top-lavel  and  operational  management  is  in 
the  tj'pes  of  problems  they  face.  Top  management  must  usually  deal  with 
problems  that  are  vaguely  defined,  imperfectly  understood,  and  difficult  to 
relate  to  criteria  for  identifying  and  evaluating  alternative  solutions.  (In 
fact,  the  choice  of  the  criteria  themselves  is  a major  part  of  the  solution 
process.)  We  denote  such  vaguely  defined  probiems  as  "issues"  lu  ’'"igure  5. 

Operational  management,  on  the  other  hand,  is  concerned  with  solving  more 
definite  problems  for  which  criteria  are  more  readily  available,  particularly 
if  top  management  is  performing  its  policy  development  role.  For  our 
purposes,  policy  represents  a constraint,  provided  by  top  management,  on  the 
range  of  solutions  available  to  operational  management.  In  reality,  there  are 
numerous  gradations  between  these  two  e.it.remes,  but  emphasizing  them  supplies 
a context  for  our  concept  of  DoD  management  roles. 
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The  menegeieent  infometion  eys,.™  i.  , e„„„eytio„  bet„e.„  top-level 
and  operational  eanageeeot.  The  term  Wgeeent  information”  includes  the 
foil  range  of  informatron  fK . between  these  two  levels,  nor  only  the  formal 
flow  provided  by  the  tomputer-n.sed  reporting  systems  and  similar  routine 
tommonrcations,  bur  also  the  informal  exchange  of  information  rharact.rired  in 
this  study  as  "institutional  knowledge".  The  issues  oouf renting  top  man- 
agement are  such  that  both  the  description  and  resolution  of  them  mast  often 
depend  on  informal  communication  with  operational  managers. 


Top-Level  (Institutioaal)  Management 

Thus,  we  see  top-level  DoD  management  as  being  primarily  concerned 
with  long-range  planning  and  with  identifying  policy  variables  that  should 
guide  such  planning.  The  level  of  defense  capability  would  be  one  such  class 
of  policy  variables.  Knowledge  about  these  variables  comes  from  the  manage- 
ment information  system.  Changes  in  them  serve  to  inform  top  management  of 
potential  issues  and  lead  to  evaluations  and,  if  necessary,  to  policy  changes. 
To  generate  policy  alternatives,  top  management  uses  relationships  between 
variables  that  relate  input  such  as  resources  to  output  such  as  defense  capa 
bility  obtained  through  analysis  of  information. 

Top  management's  knowledge  about  such  relationships  is  necessarily 
limited  because  of  the  complexity  of  the  management  structure,  its  constrained 
ability  to  absorb  detailed  information,  and  the  difficulty  of  establishing 
cause-and-effect  relationships.  However,  within  the  limits  of  its  perception 
and  the  difficulties  of  defining  appropriate  criteria,  top  management  selects 
policy  that  serves  to  constrain  operational  management.  Such  policy  must 
often  be  broad  and  somewhat  vague  in  its  guidance  due  to  the  uncertainties 
that  characterize  the  decision-making  environment. 

Operational  (Technical)  Management 

Operational  management,  in  contrast  to  top-level  management,  deals 
with  problems  that  are  better  defined  and  constrained  by  guidance  from  the  top 
level.  Such  guidance  Includes  goals,  policy,  and  resource  limitations. 
Operational  management  identifies  problems  that  arise  in  its  efforts  to  comply 
with  top-level  goals,  given  the  policy  and  resourr-i  constraints  reflected  in 
relationships  between  input  and  output  variables. 

In  some  cases,  problems  can  be  solved  by  operational  management 


without  intervention  by  top-level  management.  Thus,  a redistribution  of 
resources  within  permissible  limits  might  be  one  type  of  operational  manage- 
ment action  tor  dealing  with  an  existing  or  anticipated  problem.  In  other 
cases,  information  must  be  supplied  to  top-level  management  to  change  estab- 
lished guidance  for  solving  identified  problems. 

Such  interaction  between  levels  of  management  often  revolves  around 
reaching  a mutual  understanding  of  the  status  of  the  operational  system,  or  of 
the  relationships  between  input  and  output  variables  that  should  be  accepted 
by  top-level  management.  This  form  of  interaction  necessarily  requires  an 
information  flow  tailored  to  facilitate  top-level  management  understanding  of 
its  rule  in  effecting  solutions.  Such  understanding  might  be  conveyed  through 
observed  changes  in  management  indicators  or  through  improvement  in  the  deter- 
mination of  relationships  between  variables  contained  in  analyses  performed  by 
operational  management. 

Management  Information  System 

The  management  information  system  represents  all  the  information 
flow  between  top-level  and  operational  management.  It  includes  communications 
from  top  management,  in  the  form  of  guidance  and  questions,  specifically 
tailored  information  sent  to  the  policy  level  by  operational  management,  and 
data  prepared  by  operational  management  that  the  policy  manager  has  asked  to 
see.  Thus,  the  management  information  system  is  a composite  of  many  infor- 
mation and  communications  systems  and  sources. 

The  management  information  system,  then,  links  top-level  and  oper- 
ational management.  The  system  contains  both  formal  and  informal  types  of 
reporting  and  communication.  It  receives  raw  information  from  the  operational 
level,  which  it  proce;  ses  to  serve  both  operational  and  top  management  uses, 
and  performs  analyses  directed  at  defining  possible  problem  areas  and  at 
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quantifying  relationships  among  variables.  Structuring  the  management  in- 
formation system  to  serve  the  needs  of  top-level  management  represents  an 
important  aspect  of  the  framework  developed  in  this  study. 

Management  indicators  are  one  major  category  of  information  shared 
by  top  and  operational  management  and  used  to  identify  potential  problems. 
Another  category  is  knowledge  of  the  relationships  among  indicators.  Top 
management  uses  such  relationships  to  generate  policy  and  resource  alter- 
natives for  dealing  with  likely  causes  of  problems  and  evaluating  the  impact 
of  alternative  courses  of  action.  These  relationships  are  also  used  by  oper- 
ational management  (possibly  in  more  detail)  to  identify  problems  that  can  be 
associated  with  the  policy  constraints  imposed  by  top  management. 

It  is  useful  at  this  point  to  stress  the  importance  of  institutional 
knowledge  to  top  management  decision-making.  We  visualize  the  main  sources  of 
such  knowledge  as  located  at  the  operational  level.  Our  concept  of  reducing 
the  need  for  a heavy  formal  flow  of  information  between  the  levels  of  manage- 
ment depends  upon  how  skillfully  top  management  can  draw  upon  informal,  insti- 
tutionally available  information.  This  means  that  policy  management  and 
operational  management  must  have  shared  goals  and  objectives.  It  also  means 
that  access  to  institutional  knowledge  must  be  an  established  and  accepted 
mode  of  procedure.  We  believe  the  role  we  have  assumed  for  top-level  manage- 
ment as  a broad  policy-maker  will  both  necessitate  and  facilitate  the  ef- 
fective use  of  institutional  knowledge. 

In  this  section  we  have  differentiated  between  the  two  levels  rep- 
resented in  our  concept  of  DoD  management,  and  have  identified  the  character 
of  their  interactions  through  the  medium  of  the  management  information  system. 
In  the  next  section,  we  examine  the  use  of  this  information  system,  particu- 
larly in  the  context  of  the  kinds  of  management  tools  represented  in  our 
proposed  framework  for  policy-level  management. 
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USE  OF  INFORMATION  IN  A MANAGEMENT  SYSTEM 


Here  we  view  management  systems  from  the  perspective  of  the  tools  re- 
quired for  transforming  raw  data  into  useful  information.  We  set  this 
examination  in  the  context  of  our  investigation  of  military  logistics  manage- 
ment systems . 

The  use  of  data  in  a management  system  reflects  the  evolution  of  manage- 
ment tools  that  has  accompanied  the  maturation  of  management  technology.  We 
illustrate  this  evolution  in  Figure  6.  At  the  core  of  this  technology  is  the 
raw  data,  both  formal  operational  data  and  informal  judgmental  inputs,  sup- 
plied to  the  management  information  system  by  operational  management.  Those 
data  are  normally  subjected  to  some  type  of  analysis,  the  requirements  for 
which  are  determined  by  particular  management  practices.  The  whole  of  this 
technology  is  embedded  in  certain  management  concepts.  We  will  look  at  the 
stages  in  Figure  6 and  indicate  how  the  management  tools  developed  by  LMI  can 
contribute  to  each  aspect  of  the  management  process  represented. 

In  this  representation,  however,  no  thorough  evaluation  of  currently 
accepted  management  concepts  was  attempted;  instead,  certain  broad  assumptions 
about  organizational  roles  were  made.  The  principal  assumption  was  that  top 
DoD  management  should  be  concerned  with  broad  policy  and  long-range  planning, 
not  specific  operational  problems. 

At  the  core  of  the  system  represented  in  Figure  6 are  the  data  from  the 
operational  systems;  if  left  untreated,  the  data  reprerent  only  potential 
information.  The  next  stage  in  the  evolution  of  management  technology  is  the 
application  of  analytical  techniques.  Exemplifying  that  application  are  the 
tools  we  used,  such  as  structural  analysis  and  trend  analysis. 

Structural  analysis  represents  systematic  examination  of  activities, 
functions,  resources,  and  material  reflecting  organizational  and  hierarchical 
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relationships.  In  volume  II  of  this  study,  we  addressed  the  organization  of 
Air  Force  logistics  activities  (Base  Supply,  Base  Maintenance,  Central  Supply, 
etc.),  functions  (operations,  supply,  maintenance,  and  transportation),  ag- 
gregate resources  (funding  appropriations  and  manpower),  and  materials 
(aircraft,  engines,  exchangeables,  and  consumables).  From  structural  analy- 
sis, we  seek  a better  understanding  of  the  interrelationships  between  these 
elements  and  their  contribution  to  operational  capability. 

Trend  analysis  examines  the  variations  in  state  or  system  variables,  such 
as  OR  rates,  exchangeable  demands,  etc.,  and  attempts  to  evaluate  the  causes 
of  such  variations  by  relating  them  to  changes  in  resource  or  policy  vari- 
ables. The  interpretation  of  trends  requires  the  judgment  of  both  analysts 
and  managers. 

Both  structural  and  trend  analysis  contribute  to  the  same  objective:  to 
develop  a quantitative,  predictive  management  tool  for  relating  logistics 
input  to  operational  output.  The  analytic  knowledge  thereby  gained  should 
help  tailor  operational  information  for  use  at  the  policy  level. 

Volume  II  also  addressed  management  indicators  as  a tool,  but  stopped 
short  of  specifying  criteria  for  selecting  them.  Given  the  current  state  of 
the  art,  and  the  complex  and  dynamic  nature  of  the  logistics  system,  such 
criteria  must  be  subjective.  Hence,  managers  at  all  levels  must  rely  on  their 
own  judgment  as  to  which  indicators  are  most  important.  As  a tool,  management 
indicators  span  the  first  two  stages  represented  in  Figure  6,  with  aspect j of 
both  basic  management  information  and  moderately  advanced  analytical  tech- 
niques . 

Our  latest  analytical  efforts  include  two  relatively  new  applications  of 
available  techniques,  flow  analysis  and  resource  analysis.  The  reasons  for 
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selecting  them  are  discussed  below  under  "Candidate  Management  Tools";  chap- 
ters 3 and  4 describe  them  in  detail.  In  broad  terms,  flow  analysis  is  a 
graph-theoretic  method  of  describing  quantitatively  material  flows  between 
activities  of  an  operational  system.  Application  of  network  theory  permits 
extension  of  the  flow  analysis  to  treatment  of  capacities  in  the  operational 
system,  including  maximum  flow  through  the  system.  Flow  analysis  allows 
tradeoffs  across  the  state  variables  (the  flows  or  capacities)  both  within  and 
between  different  activities  in  the  network  (e.g.,  base  maintenance  or  depot 
maintenance);  it  can  also  be  extended  to  clarify  the  impact  of  time  delays  and 
queues  in  the  system.  Resource  analysis  is  akin  to,  and  draws  upon,  flow 
analysis;  it  examines  the  impact  of  physical  resources  (such  as  spare  parts 
inventories),  financial  resources,  manpower,  and  management  policy  on  flows 
and  capacities,  i.e.,  the  impact  of  policy  and  resource  variables  on  state 
variables . 

These  analytical  techniques  approach  the  limit  of  strictly  quantitative 
applications  within  our  representation  of  a management  system.  Proceeding 
outward  to  management  practices,  we  require  more  qualitative  and  subjective 
tools,  because  of  the  need  to  consider  management  objectives  explicitly. 
Here,  the  actions  of  managers  are  the  most  far-reaching:  long-range  planning, 
policy  development,  and  resource  allocation.  To  accomplish  these  actions, 
managers  must  negotiate  and  compromise,  trading  off  goals  with  conflicts. 
Their  decisions  cannot  be  based  solely  on  rigorous  optimization  tools  and 
formal  criteria;  they  must,  instead,  reflect  shadings  of  personal  priorities 
and  preferences  for  alternative  courses  of  action.  Consequently,  top  managers 
need  a reliable  procedure  for  evaluating  alternative  courses  of  action,  a 
technique  that  enables  them  to  combine  subjective  assessments  with  more  con- 
crete analytic  techniques.  The  technique  we  propose  is  called  hierarchical 
analysis  and  will  be  discussed  in  detail  in  chapter  5. 
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REQUIREMENTS  FOR  MANAGEMENT  TOOLS 


Thus  far,  management  activity  within  DoD  has  been  examined  from  two 
perspectives.  In  the  first  section  of  this  chapter,  we  outlined  the  dif- 
ferences between  policy-level  and  operational-level  management,  particularly 
in  terms  of  information  requirements.  The  second  section  emphasized  the 
different  ways  management  uses  information,  particularly  the  role  of  manage- 
ment tools.  One  way  of  relating  these  two  perspectives  is  to  realize  that 
policy-level  management  necessarily  Involves  more  subjective  judgment  because 
of  its  concern  with  broad  issues  and  longer-range  planning,  while  operational 
management  can  apply  more  analytic  approaches,  since  it  functions  in  a more 
constrained  and  directed  environment. 

In  volume  II  of  this  study  we  attempted  to  bridge  policy  and  operational 
management  with  management  indicators.  On  the  basis  of  our  understanding  of 
the  Air  Force  logistics  structure,  we  identified  significant  indicators  po- 
tentially of  interest  to  OSO.  Trend  analysis  was  also  used  to  evaluate  the 
indicators,  but  its  limitations  prevented  the  establishment  of  cause-and- 
effect  relationships.  Furthermore,  without  adequate  criteria  for  selecting 
and  using  indicators  it  was  impossible  actually  to  recommend  any  to  OSD. 

The  development  of  such  criteria  had  been  originally  planned  for  the 
third  phase  of  this  task.  However,  as  this  report  demonstrates,  our  viewpoint 
has  changed.  We  now  believe  that  because  of  the  dynamic  and  complex  nature  of 
the  DoD  logistics  system,  it  will  be  necessary  to  track  many  different  indi- 
cators, not  only  those  pertaining  to  recognized  problems  or  issues,  but  also 
those  helpful  iu  identifying  issues  for  policy  level  management.  The 
policy-level  staff  will  be  responsible  for  selecting  indicator.s  and  telling 
policy  managers  what  the  information  itself  means. 
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Thus,  we  recognize  that  indicators  are  only  one  aspect  of  the  necessary 
interaction  between  policy  and  operational  management.  Our  viewpoint  has 
become  more  comprehensive.  First,  a management  system  mu.st  have  some  way  of 
examining  relationships  between  variables  that  makes  use  of  aggregate  data  and 
takes  into  account  interactions  in  the  logistics  decision-making  process. 
Second,  processes  are  needed  for  specifying  goals  or  objectives  so  as  to 
associate  them  with  resource  allocation  and  policy  selection,  and  for  identi- 
fying issues  that  may  affect  goals,  resource  allocation,  or  policy,  through 
monitoring  of  the  operational  system. 

Thus,  management  tools  should  be  capable  of  organizing  objectives  sys- 
tematically and  quantitatively  and  make  explicit  use  of  judgment  at  the  policy 
level.  These  objectives  must  bt  represented  in  ways  that  then  can  be  used  in 
analytic  models.  Management  tools  must  also  be  able  to  deal  with  several 
variables  concurrently,  in  view  of  the  interactive  nature  of  a logistics 
system.  Finally,  because  policy-level  management  cannot  deal  with  operational 
details,  management  tools  have  to  operate  with  aggregate  information,  handle 
relatively  fuzzy  types  of  relationships,  and  provide  outputs  reflecting  bounds 
for  decision-making  rather  than  specific  point  estimates  or  detailed  policy 
solutions.  The  next  section  assesses  some  candidate  management  tools  in  terms 
of  these  requirements. 
candidate  MANAGEMENT  TOOLS 

In  this  section,  the  candidate  management  tools  are  briefly  rev  ‘wed  in 
terms  of  how  well  they  incorporate  multiple  objectives,  deal  with  many  inter- 
acting variables,  use  aggregate  information,  and  exploit  individual  judgment 
within  the  context  of  the  planning,  programming  and  budgeting  process.  None 
of  the  techniques  surveyed  meets  our  needs  completely.  Instead,  we  have  had 
to  modify  and  adapt  some  of  them  to  fit  our  concept  of  a DoD  policy-level 
m.anagement  system. 
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The  techniques  surveyed  have  all  been  applied  with  some  degree  of  success 
in  real-world  management  analysis.  Detailed  descriptions  of  these  tools  are 
not  included;  however,  when  possible,  we  do  cite  specific  references.  More 
details  are  intluded  for  techniques  that  are  closest  to  those  chosen  for  our 
framework. 

Regression  Analysis 

Regression  analysis  is  a method  tor  estimating  the  functional  re- 
lationship of  dependent  and  independent  variables,  taking  into  account  stat- 
istical variation.  Normally,  one  dependent  variable  is  considered  at  a time, 
and  certain  restrictive  assumptions  are  made  about  the  character  of  statis- 
tical variation.  However,  regression  analysis  is  a useful  method  for  devel- 
oping hypotheses  about  relationships. 

Input-Output  Analysis 

Input-output  analysis  treats  simultaneous  and  interactive  relation- 
ships among  many  interdependent  variables.  However,  it  usually  assumes  fixed 
and  proportionate  relationships  between  input  and  output  variables.^ 

Goal  Programming 

Goal  programming  is  an  adaptation  of  mathematical  programming  that 

allows  consideration  of  multiple  objectives.  Judgment  is  used  in  weighting 

the  objectives,  but  goal  programming  has  the  usual  limitations  of  linearity  in 

variables  required  by  linear  programming,  and  fixed  and  proportionate  re- 

2 

lationships  among  variables  are  assumed. 

System  Dynamics 


System  dynamics  represents  a systems  approach  to  analyzing  relation- 
ships among  variables  and  allows  for  the  effects  of  feedback.  Differential 
equations  are  used,  and  the  technique  becomes  quite  complicated  if  applied  to 
problems  of  more  than  a few  variables.  The  mathematical  conditions  limit  the 
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flexibility  of  representing  relationships,  and  the  required  parameters  are 

3 

often  difficult  to  estimate. 

Utility  Theory 

Utility  theory  assumes  heavy  use  of  judgment  in  developing  relation- 
ships between  variables  defining  the  benefits  and  costs  being  assessed.  Al- 
lowances for  risk  due  to  uncertainty  are  incorporated  into  the  relationships. 
However,  utility  theory  is  a highly  theoretical  technique  that  has  been 
rigorously  developed  primarily  for  relatively  well-structured  situations.  Its 

adaptation  to  complex  problems  necessarily  requires  relaxation  of  underlying 

4 

theoretical  assumptions. 

Risk  Analysis 

Risk  analysis  is  related  to  utility  theory  and  depends  heavily  on 
the  specification  of  subjective  probabilities  .and  utilities.  It  has  been  suc- 
cessfully used  in  specific  situations,  but  at  present  is  not  easily  adaptable 
to  the  complex  decision-making  proces.s  of  planning,  programming,  and  budget- 
ing.^ 


Digraph  Analysis 

Digraph  analysis  graphically  portrays  relationships  among  variables 
represented  in  qualitative  and  quantitative  dimensions.  It  has  been  used  to 
analyze  complex  policy  situations  similar  to  those  experienced  by  DoD  manage- 
ment on  an  aggregate  level.  In  some  formulations,  strict  mathematical  con- 
ditions are  imposed  to  solve  for  the  steady  state  behavior  of  the  system  being 
modeled,  but.  digraph  analysis  seems  to  have  primary  value:  Lo  us  as  a graphical 
device  for  representing  aggregate  relationships  and  variables  in  macro  analy- 
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Hierarchical  Analysis 

Hierarchical  analysis  involves  the  specification  of  objectives, 
activities  to  fulfill  them,  and  policies  to  guide  the  activities.  Within  this 
hierarchical  structure,  priorities  are  assigned  to  the  elements  at  each  level, 
according  to  their  relative  importance  in  affecting  the  elements  at  the  next 
higher  level.  The  priorities  are  established  through  pr  wise  comparisons  at 
each  level,  and  the  underlying  mathematical  theory  guarantees  preservation  of 
the  priorities  throughout  •■‘le  hierarchy.  Hierarchical  analysis  is  compatible 
with  the  decision-making  structure  developed  in  this  study  and  has  been  suc- 
cessfully applied  to  significant  policy  studies^. 

The  above  descriptions  suggest  our  preferences  for  policy-level  manage- 
ment tools.  None  of  them  exactly  suits  our  framework,  but  we  have  developed 
ways  to  adapt  and  use  them.  We  need  a tool  for  identifying  and  displaying 
relationships  among  many  aggregate  variables  and  for  treating  inter-  and 
intra-system  feedback.  Graphical  techniques  like  netwo.rk  and  digraph  analysis 
can  therefore  be  useful.  The  basic  concepts  of  system  dynamics,  especially 
the  treatment  of  feedback,  ace  also  applicable. 

A tool  for  measuring  the  effects  of  policies  and  resources  on  the  capac- 
ities of  logistics  and  operational  activities  is  also  necessary.  Here  again, 
graphical  techniques  like  digraph  analysis  provide  a point  of  departure  lor 
discovering  the  relevant  relationships  and  identifying  the  potential  impact, 
Finally,  we  visualize  the  DoD  decision-making  framework  as  having  a hierar- 
chical structure,  so  we  have  selected  a form  of  hierarchical  analysis  to  fiiJ- 
fill  the  role  of  organizing  and  prioritizing  logistics  concepts,  goals,  ob- 
jectives, and  policies. 
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TOOLS  SELECTED  BY  LMI 


On  the  basis  our  survey  of  *'hc  above  techniques,  we  have  selected 
thret,  basic  tools  for  use  in  our  analytical  framework.  They  are:  flow  analy- 
sis, resource  analysis,  and  hierarchical  analysis.  The  next  three  chapters 
describe  these  tools  in  detail;  here,  we  simply  introduce  them  and  place  them 
in  context. 

Flow  Analysis 

Flow  analysis  is  used  tc  display  the  relationships  between  logistics 
activities,  which  are  nodes  on  a flow  graph,  and  between  the  flows  and  capaci- 
cies  on  the  arcs  conne''ting  these  activities.  This  representation  is  similar 
to  that  in  Figure  1.  Two  activifes  in  an  aircraft  flow  graph  might  be 
"Flight  Operations"  and  "Base  Aircraft  Maintenance”.  The  arc  between  them 
would  then  represent  the  flow  "Number  of  Aircraft  With  Unscneduled  Failures" 
per  unit  time.  Flow  graphs  incorporate  feedback  considerations  and  can  take 
advantage  of  some  of  the  concepts  used  in  system  dynamics.  We  also  make  use 
of  concepts  from  network  theory  such  as  capacity  and  maximal  flow.  Thus,  our 
version  of  flow  analysis  is  derived  from  graph  analysis,  uses  elements  of 
system  dynamics,  and  draws  upon  the  algorithms  tor  maximal  flow  in  a network. 

Resource  Analysis 

Resource  analysis  is  also  a form  of  graph  analysis  used  to  identify 
impacts  of  resources  and  policies  on  the  state  variables  (i.e.,  flow  and 
capacities J . Used  in  this  way,  resource  analysis  provides  connections  between 
the  individual  flow  graphs  and  between  the  flow  graphs  and  hierarchical  analy- 
sis. The  connections  are  made  by  having  the  arcs  (flows  and  capacities)  of 
the  flow  graphs  correspond  to  one  type  of  node  on  the  impact  graphs.  Resource 
and  policy  variables  are  connected  to  these  nodes  through  directed  arcs. 
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These  directed  arcs,  then,  represent  the  relationships  between  a itate  vari- 
able and  resources/policy  (control)  variables.  The  priorities  developed  in 
hierarchical  analysis  should  to  some  extent  reflect  the  relationships  exposed 
hy  the  impact  graphs. 

Hierarchical  Analysis 

Hierarchical,  analysis  is  a direct  application  of  the  work  of 
Professor  Saaty  to  cur  representation  of  the  DoD  planning  process.  Hierar- 
chical analysis  is  used  in  our  framework  to  provide  an  explicit  procedure  for 
relating  defense  objectives  to  bread  logistics  concepts  and  policies.  This 
approach  enables  policy  managers  to  establish  priorities  on  systemwide  ob- 
jectives and  policies.  A connection  between  hierarchical  analysifj  and  flow 
analysis  is  possible  because  nodes  on  the  flow  graphs  (logistics  activities) 
have  been  included  as  explicit  elements  in  the  hierarchy.  We  consider  this 
application  of  hierarchical  analysis  to  DoD  policy-level  management  to  be 
unique. 

As  can  be  seen  from  these  brief  descriptions,  flow  and  resource  analysis 
fall  largely  into  the  category  of  "analytical  techniques"  according  to  our 
representation  of  a management  system  in  Figure  6.  Both  techniques  involve 
the  identil ication  and  development  of  relationships  between  system  variables, 
with  the  poss-’biiity  of  quantitative  expressions  representing  these 
relationships.  In  chapters  3 and  4 we  discuss  in  detail  what  kinds  of 
quantitative  relationships  seem  appropriate  to  the  highly  aggregate  and  dy- 
namic type  of  analysis  useful  to  policy-level  management.  Chapter  4 also 
presents  an  algorithmic  approach  to  performing  analytic  calculations  with  the 
flow  and  resource  graphs. 

We  view  1 ' erarchical  analysis  as  falling  into  the  category  of  "management 
practices",  because  development  of  the  hierarchy  involves  highly  informed 
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judgments  about  both  its  structure  and  the  priorities  established  for  the 


elements  withiu  it.  Although  hierarchical  analysis  includes  explicit  .^Igo- 
ritiuns  for  deriving  priorities,  the  structure  itself  is  more  important. 
Hierarchical  analysis  is  deS'-ribed  in  detail  in  chapter  5. 

OV’ERVIEW  OF  LMI  APPROACH 

Figure  7 is  another  representation  of  the  management  processes  described 
at  the  beginning  of  this  chapter.  Top  or  institutional  management  is  repre- 
sented by  the  two  boxes  on  the  right;  the  logistics  system  and  its  operational 
management  are  at  the  bottom;  and  the  management  information  system  is  at  the 
left . 
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The  top  management  process  thus  has  two  stages.  The  first  is  the  eval- 
uation of  defense  strategies  for  their  logistics  implications,  which  leads  to 
the  formulation  of  logistics  issues.  From  this  stage  comes  some  minimum  set 
of  logistics  goals  and  objectives.  The  second  stage  is  the  evaluation  of 
alternative  resource  allocations  and  logistics  policies  in  support  of  these 
goals  and  objectives.  Thus,  at  the  end  of  the  second  stage,  top  management 
will  have  obtained  the  resource  allocations,  policies,  and  plans  within  which 
the  logistics  system  must  operate. 

The  operational  system  functions  within  the  policy  and  resource  restric- 
I tions  thus  established.  Information  is  then  fed  back  to  top  management  where 

it  is  collected  and  analyzed. 

Management  indicators  are  a primary  means  of  providing  policy-level  man- 
agement with  information  on  the  value  of  system  variables.  Flow  and  resource 
analyses  are  designed  to  expose  and  clarify  the  relationships  between  these 
variables.  Hierarchical  analysis  assists  in  the  structuring  of  logistics 
goals  and  objectives  by  providing  a mechanism  for  interactive  analysis  of  log- 
istics issues,  taking  into  account  objectives,  policies,  and  resources. 


3.  FLOW  ANALYSIS 


STRUCTURAL  DESCRIPTION 

Chapter  1 presented  a macro  structure  of  Air  Force  logistics  (Figure  1); 
volume  II  of  this  study  depicLed  more  detailed  structures.^  The  choice  of 
these  particular  structures  was  dictated  to  a great  extent  by  their  compati- 
bility with  existing  reporting  systems.  In  this  chapter,  we  expand  the  Air 
Force  logistics  structure  to  provide  a better  accounting  of  system  flows  and 
inventories.  By  developing  individual  flow  graphs  for  different  categories  of 
materiel,  we  can  take  advantage  of  the  algorittunic  potential  of  that  struc- 
ture. 

Initial  Flow  Graph  Development 

The  categories  of  materiel  selected  for  initial  flow  graph  develop- 
ment were  aircraft,  engines , exchangeable  items,  and  consumable  items.  Candi- 
dates for  future  development  include  support  equipment,  missiles  and  am- 
munition, and  manpower.  We  emphasize  that  the  structure  developed  for  Air 
Force  logistics  is  not  readily  transferable  to  Army  and  Navy  operations. 
Service  data  reporting  systems  are  constructed  very  differently,  and  the  data 
elements  are  interpreted  and  measured  differently.  The  missions  of  each 
Service,  their  logistics  support  structures,  and  their  corresponding  manage- 
ment philosophies  are  sufficiently  diverse  to  defy  direct  comparison. 

We  chose  the  flow  graph  as  the  structural  representation  of  Air 
Force  logistics  because  it  focuses  attention  on  the  logistics  processing  of 
materiel.  Examples  of  flow  graphs  are  presented  later  in  Figures  8 through 
11.  With  a complete  flow  graph,  rates  of  materiel  flow,  potential  bottlenecks 


in  the  logistics  system,  and  limitations  on  support  capability  can  be  identi- 
fied. The  steady  state  inventories  of  aircraft  and  support  materiel  can  be 
identified,  as  well  as  the  transient  behavior  of  these  inventories  when  the 
system  is  subjected  to  perturbations.  By  linking  resources  and  policies  to 
the  flows  and  capacities  of  the  logistics  system  or  to  the  states  of  aircraft 
in  that  system,  we  can  evaluate  resource  and  policy  tradeoffs  for  their  impact 
on  logistics  capability.  These  impacts  are  the  subject  of  chapter  4,  "Re- 
source Analysis." 

Logistics  Activities 

There  are  two  structural  elements  in  a flow  graph:  nodes  and  arcs. 
Nodes  are  the  circles  or  static  points  on  the  flow  graph;  arcs  are  the  arrows 
connecting  the  nodes  and  indicating  movement  of  materiel  from  one  node  to 
another. 

What  the  nodes  and  arcs  represent  depends  on  the  analytical  mode  in 
which  the  flow  graph  is  used.  In  the  state  transition  mode,  nodes  represent 
states  of  the  materiel  being  processed,  and  arcs  represent  the  transition  from 
one  state  to  another.  This  mode  requires  state  transition  rules  or  proba- 
bilities. In  the  flow  network  mode,  nodes  represent  logistics  or  operational 
activities/locations;  arcs  represent  the  flow  of  materiel  from  one  activity  to 
another.  Logistics  activities  are  those  places  where  materiel  is  physically 
processed,  i.e.,  inspected,  tested,  repaired,  stored,  or  distributed. 

We  have  already  shown  that  aggregation  is  necessary  to  reduce  both 
the  complexity  of  the  flow  graph  and  the  quantity  of  information  required  to 
support  it  at  a manageable  level.  Our  selection  of  aggregate  logistics  activ- 
ities (or  materiel  .states)  is  based  on  compatibility  with  existing  reporting 
systems.  We  identify  two  functions  - maintenance  and  supply  - and  two  ech- 
elons - depot  (or  central)  and  organizational  (or  base).  The  transportation 


3-2 


function  is  associated  with  the  flow  of  materiel  from  one  activity  to  another 


(i.e.,  the  transition  from  one  state  to  another).  Other  delineations  and 
lavels  of  detail  are  possible  and  may  be  necessary  for  certain  management 
responsibilities. 

The  selection  of  specific  activities  should  Ideally  be  accomplished 
with  the  participation  of  the  logistics  managers  themselves.  The  flow  graph 
must  reflect  their  conception  of  the  appropriate  level  of  managerial  control. 

Logistics  Flows  and  Capacities 

In  our  framework,  we  concentrate  on  using  the  flow  graph  in  the  flow 
network  mode,  as  opposed  to  the  state  transition  mode.  In  the  flow  network 
mode,  both  a flow,  measured  in  units  of  materiel  per  unit  time,  and  a capac- 
ity, or  a maximum  flow,  are  associated  with  each  arc.  The  notion  of  capacity 
is  extremely  important  in  developing  a concept  of  system  capability,  i.e., 
readiness.  If  we  could  specify  capacities  for  all  the  arcs,  we  could  calcu- 
late a maximum  flow  in  the  system.  This  maximum  flow  would  correspond  to  a 
surge  or  moblliaation  capability. 

In  chapter  4,  flow  and  capacity  variables  represent  the  "state 
variables"  of  the  logistics  system.  They  are  the  variables  management  wishes 
to  keep  within  some  limits  so  that  the  system  can  adequately  perform  its 
function.  The  performance  of  the  system  may  then  be  measured  as  a rate  of 
flow  or  a capacity  utilization. 

Resource  and  policy  variables,  on  the  other  hand,  represent  the 
"control  variables"  of  the  .system.  They  are  the  variables  management  manipu- 
lates to  maintain  the  state  variables  within  prescribed  limits.  Measures  of 
productivity  and  policy  compliance  are  usually  expressed  in  terras  of  the 
control  variables. 
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We  can  also  use  flows  aad  capacities  to  Identify  the  logistics 
objectives  corresponding  to  specified  operational  objectives.  Macro  ob  - 
jectives  like  "increase  the  capacity  of  base  maintenance  to  process  aircraft," 
however,  tend  to  be  too  aggregate  and  abstract  to  be  a basis  for  the  formu- 
lation of  logistics  policy  and  resource  guidance.  A slightly  more  detailed 
breakout  of  objectives  can  provide  management  with  the  degree  of  concreteness 
needed  to  assess  t)uv  more  "macro"  objectives  properly.  These  objectives  are 
structured  by  means  of  hierarchical  analysis,  described  in  chapter  5. 

While  flows  of  materiel  may  exhibit  substantial  variability  at 
different  points  in  time,  they  are  relatively  easy  to  manage.  Capacities , on 
the  other  hand,  are  extremely  difficult  to  measure.  In  the  Industrial  sector, 
this  does  not  present  the  problem  it  does  in  the  military  sector.  Economic 
incentives  impel  an  industrial  organization  to  utilize  its  capacity  to  the 
fullest  possible  extent,  or  to  reduce  or  inactivate  excess  capacity.  Because 
day-to-day  operations  are  very  close  to  capacity,  operational  measures  such  as 
materiel  flows  are  reasonable  indicators  of  the  organization's  health. 

In  DoD,  on  the  other  hand,  the  incentives  and  even  the  military  role 
itself  require  maintaining  excess  capacity.  Hence,  tools  comparable  to  oper- 
ating statements,  balance  sheets,  and  financial  ratios  simply  are  not  as  use- 
ful to  top-level  DoD  management  as  they  are  to  the  board  of  directors  of  an 
industrial  organization. 

Queues,  which  can  build  up  in  a system,  provide  a source  of  measures 
which  can  serve  as  "proxies"  for  capacities.  Backlogs  of  repair  are  examples 
of  such  proxies.  These  measures  are  only  proxies  because  they  do  not  neces- 
sarily indicate  full  capacity  utilization  or  overload.  A repair  backlog,  for 
example,  is  sometimes  allowed  to  build  up  simply  because  there  is  no  immediate 
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demand  for  the  item.  Also,  capacities  are  dependent  on  the  particular  con- 
ditions existing  at  any  point  in  time.  Hence,  the  capability  of  a logistics 
system  to  support  a wartime  effort  will  vary  from  scenario  to  scenario,  and 
any  attempt  to  measure  that  capability  must  consider  a variety  of  possible 
conditions . 

Aircraft 

A flow  graph  for  Air  Force  aircraft  is  shown  in  Figure  8.  Because 
the  structure  of  the  flow  graph  serves  to  filter  information  and  hence  to 
facilitate  communication  between  levels  of  management,  it  should  reflect  a 
reasonable  consensus  of  what  constitutes  the  "macro"  logistics  system.  Again, 
the  selection  of  a structure  should  ideally  be  left  to  the  managers  who  will 
be  using  it.  The  assessment  of  alternative  structural  concepts  for  DoD  logis- 
tics is,  in  fact,  an  important  role  of  institutional  management.  Such  assess- 
ments may  establish  the  need  for  new  policies  to  change  logistics  system 
structures.  For  example,  the  establishment  of  more  centralized  intermediate 
maintenance  activities,  each  serving  a number  of  Air  Force  bases  and  field 
orgmizations , might  require  a change  in  the  flow  graphs.  There  is  nothing 
unique  about  the  flow  graph  in  Figure  8;  it  simply  represents  our  perception 
of  the  current  logistics  system. 

Each  circle,  or  node,  in  Figure  8 represents  an  activity  or  location 
at  which  aircraft  are  maintained,  parked,  or  flown.  The  loops  at  each  node 
are  for  lise  in  the  state  transition  mode.  Each  loop  represents  a pool  of 
aircraft  at  that  location  and  corresponds  to  an  aircraft  state  (i.e.,  in 
flight,  operationally  ready,  not  operationally  ready,  and  in  depot  mainte- 
nance). In  the  flow  network  mode,  aircraft  are  on  an  arc  being  processed  from 
one  location  to  another.  In  either  mode,  all  Air  Force  aircraft  arc  somewhere 
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on  the  diagram  at  any  point  in  time.  The  dotted  arcs  represent  ways  in  which 
the  total  number  of  aircraft  in  the  system  can  change.  Hence,  the  industry 
node  serves  as  a "source"  of  aircraft  aq'd  the  attrition  node  as  a "sink." 

We  intentionally  omitted  the  transportation  activity  as  a separate 
node  or  set  of  nodes,  primarily  because  the  length  of  time  an  aircraft  is  in 
transit  is  usually  small  relative  to  the  times  it  is  in  other  states.  In  all 
our  current  flow  graphs,  a problem  in  transportation  might  be  reflected  as  an 
Increased  time  between  transitions  in  the  state  transition  mode,  or  as  a 
decreased  flow  and  capacity  in  the  flow  network  mode.  It  may  become  necessary 
to  account  more  explicitly  for  transportation  activity  if  major  problems 
develop  there,  particularly  when  the  flow  graph  is  used  in  the  state  trans- 
ition mode. 

While  we  have  been  discussing  this  flow  graph  in  terms  of  total  Air 
Force  aircraft,  it  can  also  be  used  for  aircraft  classes  (e.g.,  strategic, 
tactical,  transport,  tankers,  etc.)  and  individual  aircraft  types  (e.g.,  F-4, 
F'13,  A-7,  B-52,  etc.).  The  more  specialized  flow  graphs  would  be  appropriate 
in  many  cases.  When  aircraft  types  and  classes  are  aggregated  in  a single 
flow  graph,  information  on  deviations  within  a specific  aircraft  class  or  type 
may  be  lost. 

Engines 

Figure  9 is  a flow  graph  for  aircraft  engines.  Again,  the  loops 
provide  an.  accounting  of  engines,  that  is,  engines  are  either  installed  on  an 
aircraft,  being  worked  on  in  maintenance  (base  or  depot),  or  being  stored  in  a 
rotatable  engine  pool  (base  or  central).  Engines  can  also  be  subdivided  into 
classes,  e.g..  Jet  and  reciprocating. 
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Exchangeable 


Exchangeable  flows  are  depicted  in  Figure  10.  War  Reserve  Materiel 
(WRM)  is  an  important  addition  to  this  graph,  for  WRM  can  also  be  used  to 
satisfy  peacetime  requirements  if  certain  policy  criteria  are  met, 

The  squares  in  Figure  10  distinguish  aircraft  maintenance  activities 
from  reparable  maintenance.  It  is  at  these  square  nodes  that  components  are 
removed  from  and  replaced  on  individual  aircraft. 

Consumables 

The  consumable  flow  graph  in  Figure  11  is  much  simpler  than  the 
others,  primarily  due  to  the  absence  of  component  repair. 

What  is  not  considered  in  any  of  the  flow  graphs  is  the  impact  of 
flows  and  capacities  in  one  graph  on  those  in  another.  Consumable  flows 
affect  the  maintenance  activities  of  all  the  other  flow  graphs.  Exchangeable 
flows  affect  engine  and  aircraft  maintenance,  and  engine  flows  affect  aircraft 
maintenance.  These  effects  will  be  discussed  more  explicitly  in  chapter  4. 
ANALYTICAL  CAPABILITY  OF  FLOW  GRAPHS 
Network  Analysis 

A primary  technique  for  exploiting  the  algorithmic  potential  of  the 
flow  graph  involves  thu  calculation  of  the  maximum  flow  in  the  system.  This 
calculation  identifies  activities  that  will  be  operating  at  capacity  when  the 
system  is  producing  maximum  output.  Thus,  potential  bottlenecks  can  be  sin- 
gled out.  For  example,  suppose  analysis  showed  that  the  factors  limiting 
aircraft  sortie  capability  were  the  availability  of  fuel  and  the  number  of 
trained  pilots,  rather  than  the  capability  of  the  logistics  activities  to 
produce  operationally  ready  aircraft.  Management  should  then  concentrate  on 
improving  fuel  and  pilot  availability  and  not  on  increasing  the  capacity  of 
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EXCHANGEABLE  FLOWS 


logistics  activities.  Naturally  other  considerations  enter  into  such  a de- 
cision, for  example,  the  lead  time  needed  to  implement  capital  improvements. 
These  tradeoffs  are  discussed  in  the  following  subsection. 

2 

The  classic  work  jn  network  analysis  is  Ford  and  Fulkerson.  Since 
then,  there  have  been  many  other  books  and  articles  on  the  subject,  and  a 
number  of  applications  have  been  attempted.  Cue  of  the  more  recent  examples 

3 

is  a "Dynamic  Flight  Student  Flow  Model"  developed  by  Caves  and  Wilkinson. 
The  model  produces  a minimum  time-to-train  solution.  If  the  costs  associated 
with  particular  flows  are  identified,  a minimum  cost  solution  for  a given 
level  o'  output  can  also  be  calculated. 

At  a higher  level  of  sophistication,  a tool  developed  by  Forrester  - 

4 

system  dynamics  - gees  beyond  network  analysis.  System  dynamics  exposes  the 
transient  and  cyclical  behavior  of  a system's  variables  rather  than  simply  the 
static,  steady-state  behavior.  These  more  complex,  dynamic  characteristics 
result  from  the  multiple  and  non-linear  feedback  occurring  among  the  variables 
of  complex  systems.  System  dynamics  generally  involves  the  development  of 
differential  equations  to  describe  the  system.  These  equations  can  then  be 
incorporated  into  a computer  simulation  to  identify  time  leads  and  lags,  de- 
termine sensitivity  to  perturbations,  and  project  long-range  system  stability. 

Unfertunateiy , the  development  of  a reasonable  set  of  differential 
equation::  i?  both  difficult  and  time-consuming.  As  a result,  mo.st  appli- 
cations have  been  limited  to  consideration  of  only  a small  number  of  varia- 
bles. However,  some  recent  applications  of  system  dynamics  have  simplified 
the  model  development  by  relying  on  subjective  parameters  for  variables  dif- 
ficult :o  measure.  An  example  is  the  work  of  Killingsworth  and  Cummings.^ 
They  develop  a relatively  simple  model  and  adapt  it  to  the  system  dynamics 
simulation  language  and  software  package,  DYNAMO. 
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Simulation  models  can  also  be  developed  from  the  flow  graphs  in  the 
state  transition  mode.  Such  a simulation  requires  either  the  specification  of 
transition  probabilities  at  each  discrete  time  unit  or  the  specification  of 
mean  transition  times.  Mission  cycles  are  often  modeled  in  this  way. 

Tradeoff  Analysis 

Flow  graphs  can  help  clarify  certain  tradeoffs  in  logistics  systems, 
including  those  between  alternative  support  concepts  and  between  capital  in- 
vestment and  operational  expenditures.  Additionally,  the  association  of  dif- 
ferent degrees  of  uncertainty  with  various  support  concepts  and  with  capital 
investment  allows  consideration  for  risk  tradeoffs. 

Based  on  our  flow  graphs,  support  concept  tradeoffs  would  correspond 
either  to  a redesign  of  the  logistics  system  (i.e.,  a change  in  the  structure 
of  the  flow  graph)  or  a shift  in  emphasis  from  one  part  of  the  system  to  an- 
other. For  example,  greater  reliance  on  base  maintenance  or  the  elimination 
of  the  depot  level  altogether  would  represent  a mere  decentralized  support 
concept.  A reliability-centered  maintenance  concept  might  have  an  effect  on 
scheduled  maintenance  and/or  overhauls. 

Tradeoffs  between  capital  investment  and  operational  expenditures 
correspond  to  tradeoffs  between  increasing  system  capacities  and  increasing 
peacetime  flows.  These  tradeoffs  must  take  into  consideration  probable  war- 
time scenarios,  time  perceptions  and  preferences,  and  the  impact  of  peacetime 
operations  on  mobility  and  surge  capability.  Some  level  of  peacetime  oper- 
ations, for  example,  is  necessary  to  train  pilots,  develop  logistics  skills, 
and  simply  keep  the  system  "in  tune." 

The  most  important  considerations  in  these  tradeoffs  are,  of  course, 
the  relative  costs  and  risks  of  the  alternatives.  These  will  be  discussed 
further  in  chapter  4.  Risks  arise  as  a result  of  difficulties  in  measuring 
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capacities  and  in  estimating  changes  in  them.  These  difficulties  stem  from 
the  fact  that  a capacity  represents  a system's  potential  and  is  not  directly 
observable  unless  the  system  is  operating  at  capacity. 

A system's  potential  depends  on  the  conditions  under  which  it  will 
be  asked  to  respond.  The  development  of  scenarios  is  a typical  method  used  to 
establish  these  conditions.  Even  when  the  worst  case  scenario  is  used,  how- 
ever, some  asstimptions  about  the  conditions  (sometimes  referred  to  as  exo- 
geneous  variables)  must  be  made  when  assessing  capacity.  One  of  the  roles  of 
the  institutional  management  of  DoD,  in  fact,  ought  to  be  the  structuring  and 
evaluation  of  these  assumptions.  Uncertainty  with  respect  to  these  assump- 
tions may  make  it  desirable  to  select  alternatives  with  less  expected  benefit 
(or  utility)  simply  to  avoid  the  risk  associated  with  other  alternatives.  The 

treatment  of  risk  has  been  accomplished  with  a number  of  techniques.  They 

6 

range  from  the  simple  treatment  of  Hertz  to  the  multiple  objective,  utility 
theory  approach  of  Keeney  and  Raiffa.^ 

APPLICATION  OF  FLOW  GRAPHS 
Measurement  of  Flows 

We  can  derive  a reasonable  approximation  of  the  actual  flows  in  the 
fli . graphs  over  a given  period  of  time  (e.g.,  a year)  from  the  manipulation 
of  logistics  data.  The  aircraft  flows  in  Figure  8,  for  example,  could  be 
calculated  with  a knowledge  of  average  aircraft  inventory,  average  OR  rates, 
NOR  (Unscheduled)  rates,  and  NOR  (Scheduled)  rates,  aircraft  sorties,  aircraft 
flight  hours,  aircraft  depot  hours,  average  depot  processing  time  ptr  aircraft 
(i.e.,  depot  flow  time),  and  .average  aircraft  failures  per  flight  hour. 

Other  data  could  be  substituted  for  these  measures.  We  could,  for 
example,  replace  the  last  three  data  items  by  the  number  of  aircraft  sent  la 
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the  depot  and  the  average  time  aa  aircraft  occupied  a NOR  (Unscheduled)  (i.e., 
unscheduled  maintenance  flow  time)  and  NOR  (Scheduled)  (i.e.,  scheduled  main- 
tenance flow  time)  status.  If  significant  changes  occurred  in  these  measures 
over  the  period  of  concern,  the  beginning-of-period  and  end-of-period  data 
would  also  be  valuable.  A change  in  the  backlog  of  aircraft  at  the  depot,  for 
example,  would  indicate  a difference  between  the  number  of  aircraft  sent  to 
the  depot  and  the  number  returned  to  operational  units. 

To  demonstrate  the  type  of  calculation  needed  to  assign  an  average 
flow  to  each  arc  of  Figure  ?,  we  extracted  the  following  FY  1976  data  from  our 
volume  II  report: 

Aircraft  Inventory  = 9,289  aircraft 

Sorties  = 1,520,000  aircraft 

NORS-G  Hours  = 4,010,000  hours 

NORM-G  (Scheduled)  Hours  = 5,750,000  hours 

NORM-G  (Unscheduled)  Hours  = 11,490,000  hours 

Depot  Hours  s 9,430,005  hours 

To  perform  the  calculations,  we  need  to  assume  a percentage  rate  for  the 
number  of  sorties  that  result  in  a not  operationally  ready  condition.  We  also 
need  average  lengths  of  time  that  aircraft  remain  in  scheduled  maintenance  and 
in  depot  maintenance.  For  our  example,  we  assume; 


Failure  Rate 

Average  Scheduled  Mainte- 
nance Flow  Time 


Average  Depot  Flow  Time 


= 65%  of  sorties 


= 7 days  x 24  hrs./day 

= 168  hrs. /aircraft 

= 150  days  x 24  hrs./day 

= 3600  hrs . /aircraft 


The  calculations,  then,  are: 

Aircraft  Returning  from  Flight  with  Failures  = 
.65  X 1,520,000  = 980,000  aircraft/yr. 
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Aircraft  Processed  through  Scheduled  Maintenance  = 

5.750.000  T 168  = 34,226  aircraft/yr. 

Aircraft  Processed  by  Depot  Maintenance  = 

9.430.000  -r  3600  = 2619  aircraft/yr. 

Average  Unscheduled  Maintenance  Flow  Time 

11.490.000  T 988,000  = 11.63  hrs. /aircraft 
Measurement  of  Capacities 

If  a significant  change  in  flow  occurs  between  the  beginning  and  the 
end  of  a period,  the  indications  are  that:  (1)  a change  in  capacity  occurred 
at  some  point  in  the  system;  (2)  the  utilization  of  that  capacity  changed;  or 
(3)  a change  in  policy  had  the  effect  of  reducing  capacity.  An  increase  in 
the  backlog  of  aircraft  at  the  depot,  for  example,  might  indicate  that  the 
capacity  of  the  depot  to  process  aircraft  had  been  reached,  or  alternatively, 
that  depot  personnel  were  being  utilized  for  other  functions.  A backlog, 
however,  should  only  be  regarded  as  a "proxy"  for  capacity.  A reported  back- 
log often  does  not  reflect  a repair  workload  requirement.  This  could  be  a 
result  of  the  retention  of  items  at  that  location  for  insurance  purposes,  for 
example. 

When  logistics  operations  at  an  activity  reach  capacity,  a further 
increase  in  the  rate  of  aircraft  sent  to  that  activity  will  result  in  an  in- 
crease in  the  average  time  to  process  an  aircraft  there.  This  increase  should 
be  reflected  as  a difference  between  the  aircraft  sent  to  that  activity  and 
the  aircraft  processed  by  that  activity  over  the  period  of  concern.  When 
operations  are  not  at  capacity,  measurements  that  would  indicate  a change  in 
capacity  are  very  difficult  to  obtain. 

Capacity  measurements  are  easier  to  obtain  in  relatively  simple  and 
repetitive  operations  than  in  the  multi-faceted  operations  that  characterize 
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logistics  activities.  But  even  in  these  simple  operations,  attainment  of  a 
meaningful  measure  often  means  stressing  the  system  to  its  limit.  Operational 
readiness  inspections,  for  example,  are  periodically  performed  to  test  the 
capability  of  selected  activities;  but  as  a source  of  data,  inspections  are 
extremely  expensive  and  limited  to  what  can  be  measured  in  short  periods  of 
time.  This  is  often  not  satisfactory  for  determining  a sustained  capability. 
Recent  war  data,  when  available,  can  be  used  in  conjunction  with  a simulation 
model  such  as  a mission  cycle  model  or  perhaps  the  Air  Force  Logistics  Compos- 
ite (LOOM)  model. 

Since  approximations  are  usually  sufficient  for  performing  policy 
functions  at  the  institutional  level  of  management,  simple  calculations  are 

O 

often  adequate  for  estimating  a capacity.  Stoller  bas  identified  four  system 
parameters  that  can  be  used  to  estimate  capacity; 

Production  Rate  - the  average  output  of  the  system 

Throughput  Time  - the  average  time  required  per  unit  output  to 

process  through  the  system 

Utilization  Rate  - the  average  fraction  of  available  production 

time  during  which  productive  facilities  are 
actively  processing  units  through  the  system 


Waiting  Rate 


the  average  fraction  of  throughput  time  during 
which  units  are  not  actively  being  processed  by 
the  system. 


Often,  estimates  of  parameters  like  these  are  available  from  models  operated 
by  commands  within  the  Military  Departments.  More  sophisticated  calculations 
than  those  used  by  Stoller  are  based  on  queuing  theory  and  have  been  developed 
to  estimate  sortie  capability  as  a function  of  maintenance  personnel , mainte- 
nance team  size,  and  number  of  teams.  A simple  example  of  capacity  ertimation 

9 

was  used  in  a 1975  GAO  report. 
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THE  SIGNIFICANCE  OF  INSTITUTIONAL  KNOWLEDGE 


The  point  to  be  made  is  that,  while  capacities  are  very  difficult  to 
measure  directly,  there  are  proxies,  simple  calculations,  and  simulations, 
which  address  capacity  indirectly.  Although  the  resulting  estimates  are  ap- 
proximations, they  often  provide  sufficient  information  for  top-level  DoD 
management  to  perform  its  policy-making  functions.  Those  functions  Include 
the  management  of  excess  capacity  (sometimes  referred  to  as  "alack").  Only  by 
addressing  capacity  can  resources  and  policies  be  linked  to  an  overall  defense 
capability. 

Because  of  the  problems  associated  with  measuring  capacity,  greater  re- 
liance must  be  placed  on  expert  managerial  judgment  - what  we  have  been  refer- 
ring to  as  institutional  knowledge.  This  is  knowledge  acquired  through 
Individual  experience  of,  and  exposure  to,  the  intricacies  of  logistics  sys- 
tems. A major  challenge  in  developing  a policy-level  analytical  capability  is 
hew  to  exploit  the  institutional  knowledge  available.  We  discuss  this  chal- 
lenge further  in  succeeding  chapters. 
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4.  RESOURCE  ANALYSIS 


STRUCTURAL  DESCRIPTION 

This  chapter,  describes  the  impacts  of  resources  aod  policies  on  the 
system  flows  and  capacities  represented  by  the  flow  graphs  in  chapter  3. 
’’Resource  Analysis"  is  our  term  for  a tool  designed  to  expose,  display,  and 
analyze  these  impacts.  We  explain  the  structure  of  this  tool,  the  problems  in 
quantifying  it,  and  its  potential  uses.  Specific  uses  will  largely  depend  on 
future  methodological  development,  but  the  basic  use  of  resource  analysis  is 
to  organize  and  integrate  information  about  relationships  between  control 
varicbles  (resources  and  policies)  aod  state  variables  (flows  and  capacities). 
This  type  of  information,  even  if  approximate,  is  essential  to  top-level  DoD 
involvement  in  planning,  programming,  and  budgeting,  and  other  policy-making 
activities . 

The  Use  of  Impact  Graphs 

Traditional  methods  of  treating  control  variables,  particularly 
resources,  include  the  development  of  cost-estimating  relationships  from 
historical  data  and  the  construction  of  resource  allocation  models  (e.g., 
mathematical  programming),  which  either  minimize  cost  for  a specific  goal  or 
maximize  benefit  for  a specific  cost.  There  are  two  problems  in  applying  this 
approach  to  policy-level  concerns. 

First,  the  relationships  between  highly  aggregate  variables  tend  to 
be  vague  and  ill-structured,  both  intuitively  and  empirically.  This  is  be- 
cause the  scope  of  policy-level  management  is  much  larger  than  that  addressed 
by  the  optimization  models  just  mentioned.  Not  only  does  the  number  of  signif- 
icant variables  increase  by  orders  of  magnitude,  but  the  variables  themselves 
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are  also  complexly  interrelated.  Top-level  management,  unlike  operational 
management,  deals  with  the  whole  logistics  system  the  many  management 
levels  within  it.  Hence,  policy-level  managers  are  interested  in  socio- 
technical  relationships,  rather  than  simply  technical  ones.  Historical  data, 
however,  are  not  very  useful  in  developing  sociotechnical  relationships, 
because  human  beings  can  exhibit  innovative  and  adaptive  behavior  that  cannot 
be  inferred  directly  from  historical  performance. 

The  second  problem  with  traditional  methods  of  treating  control 
variables  is  that  the  relevant  criteria  for  policy-making  are  never  as  sim- 
plistic as  "minimizing  cost"  or  "maximizing  benefit."  Resolution  of  con- 
flicting criteria  is  a major  responsibility  of  top  management.  A criterion 
like  "readiness"  is  extremely  vague  and  involves  many  interrelated  factors. 
Measures  like  the  OR  rates  discussed  in  chapter  1 simply  do  not  capture  the 
total  concept.  The  notion  of  capacity  introduced  in  chapter  3 was  an  attempt 
to  address  readiness,  but  capacities  are  also  very  difficult  to  measure 
directly. 

Recognition  of  these  problems  led  us  to  a more  descriptive  approach 
to  the  treatment  of  control  variables.  This  approach  focuses  on  providing  a 
structure  that  links  the  control  variables  to  the  state  variables  so  as  to 
accommodate  approximate,  discontinuous,  and  other  ill-structured  relation- 
ships. Management  can  use  this  structure  normatively  by  experimenting  inter- 
actively wlbh  alternative  parameter  values  and  individually  assessing  the 
results.  This  interaction  can  range  from  using  the  structure  simply  to  organ- 
ize one's  ideas  about  a particular  policy  issue  to  experimenting  with  alter- 
native mixes  of  resources  and  policies  in  a computerized  version  (assuming 
that  sufficient  quantification  has  been  introduced). 
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The  impact  graph  in  Figure  12  depicts  the  structure  of  resource 
analysis.  In  an  impact  graph,  an  arrow  represents  the  relationship  between  a 
resource/policy  variable  and  a capacity  from  a flow  graph.  There  may  also  be 
impacts  from  the  flows  and  capacities  from  other  flow  graphs.  The  central 
circle  in  Figure  12  represents  a capacity;  the  variables  surrounding  the 
capacity  are  those  over  which  management  can  exercise  some  control.  We  chose, 
for  example,  to  represent  resource  variables  by  broad  budget  categories. 
Small  shifts  in  funds  allocated  to  these  categories  can  have  a significant 
effect  on  the  performance  and  capability  of  the  logistics  system. 

It  is  necessary  to  distinguish  policy  variables  from  resource  vari- 
ables, since  some  policies  are  difficult  to  relate  directly  to  resources. 
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Yet,  because  they  have  a significant  impact  on  the  system,  some  policy  vari- 
ables must  be  included.  Examples  of  such  variables  are  scheduled  maintenance, 
frequency  of  programmed  depot  maintenance,  and  design  reliability  and  main- 
tainability guidelines  for  newly  acquired  aircraft.  A policy  variable , how- 
ever, is  not  itself  a policy;  it  only  reflects  a policy.  (We  are  using  the 
word,  "policy,"  in  a very  broad  context.  The  distinguishing  characteristic  of 
a "policy"  is  that  it  has  the  effect  of  limiting  the  alternatives  available  to 
operational  management.) 

There  are  other  variables  affecting  capacity,  such  as  flows  or  ca- 
pacities from  other  flow  graphs,  but  there  are  also  variables  that  might  best 
be  classified  au  exogenous.  These  variables  are  not  directly  controllable, 
but  provide  the  context  within  which  the  logistics  system  and  its  management 
operates.  Exogeneous  variables  are  not  included  in  the  impact  graphs  pre- 
sented in  this  chapter.  But  relationships  between  control  variables  and  state 
variables  do  reflect  the  impact  of  exogeneous  variables.  In  some  policy 
situations,  exogeneous  variables  may  be  so  constraining  and  critical  that  they 
should  be  explicitly  included  in  the  structural  representation.  This  type  of 
variable  (e.g.,  economic  stability,  cultural  change,  energy  availability, 
etc.),  however,  is  frequently  very  difficult  to  measure. 

The  crucial,  and  as  yet  still  unresolved,  issue  in  developing  impact 
graphs  is  the  dngree  to  which  the  relationships  between  control  variables  and 
state  variables  can  and  should  be  quantified.  Even  without  any  quantifi- 
cation, the  Impact  graph  does  provide  a visual  representation,  which  can 
assist  management  in  a qualitative  assessment  of  the  potential  impacts  of 
changes  in  control  variables.  Impact  graphs  can  also  serve  as  a frame  of 
reference  for  raising  questions  and  otherwise  communicating  about  logistics 
management.  We  discuss  quantification  problems  and  the  potential  uses  of 
quantified  impact  graphs  in  the  "Analytical  Capability"  section  below. 
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Resources 


In  organizations  like  DoD,  which  consume  large  quantities  of  re- 
sources, resource  allocation  represents  a primary  constraint  on  the  capacity 
of  the  system  being  managed.  The  actual  allocation  is  a complex  process, 
involving  extensive  bargaining  and  compromising  among  many  parties.  The  Plan- 
ning, Programming,  and  Budgeting  System  (PPBS)  provider  the  schedule  for  this 
process.  The  role  of  the  Assistant  Secretary  of  Defense  and  his  staff  in 
resource  allocation  is  one  of  guidance  and  review.  Resource  or  fiscal  guid- 
ance as  established  In  documents  like  the  Planning  and  Programming  Guidance 
Memorandum  (PPGM),  while  not  necessarily  binding  on  the  Services,  reflects  the 
general  direction  In  which  the  current  administration  would  like  to  see  the 
Defense  Establisloment  move.  The  review  of  Program  Objective  Memoranda  (POMs) 
and  budget  submissions  is  designed  to  ensure  that  the  proposed  distribution  of 
resources  is  in  consonance  with  the  interests  of  DoD  as  a whole  f^iid  with  other 
Federal  Government  priorities. 

Changes  In  resource  allocation  also  represent  managerial  potential 
for  changing  the  operations  and  structure  of  a system.  Resources,  however, 
ara  seldom  dramatically  reallocated  from  year  to  year.  The  bulk  of  DoD  re- 
sources is  needed  to  meet  recurring  requirements  established  in  previous 
years.  Those  requirements  develop  a momentum  difficult  to  stop  without  creat- 
ing turmoil  and  disruption  in  the  system.  Hence,  the  uoe  of  resources  as  a 
means  of  control  tends  to  be  limited  to  incremental  changes  in  the  allocation 
of  the  small  portion  of  the  budget  that  can  be  considered  discretionary.  Even 
small  changes  can  have  significant  impacts  on  the  logistics  systems,  however. 

In  addition  to  resource  allocation,  management  also  has  some  dis- 
cretionary power  as  to  the  rate  at  which  those  resources  are  used  over  the 
budget  period.  In  many  instances,  it  may  be  desirable  to  retain  some  excess 
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resources.  This  gives  management  a certain  flexibility  in  responding  to 
unexpected  developments  liKe  an  energy  crisis.  However,  there  are  cost  in- 
centives favoring  the  early  disposition  of  allocated  resources.  One  of  man- 
agement's dilemmas  is  to  find  a balance  between  these  conflicting  aspects  of 
resource  utilization.  The  resolution  of  this  dilemma  is  generally  communi- 
cated through  statements  of  policy.  In  the  impact  graphs,  we  treat  such 
policies  with  selected  policy  variables. 

Policies 

If  resource  variables  represent  a means  of  exerting  ^^rec_t  control 
on  the  sy.stem,  policy  variables  represent  a more  subtle  means.  The  policy 
variables  selected  for  impact  graphs  should  have  a potentially  strong  impact 
on  the  logistics  system,  but  be  difficult  to  relate  directly  to  a resource. 
This  does  not  preclude  converting  policy  variables  to  resource  units  of  meas- 
urement. 

In  this  context,  policies  represent  a wide  range  of  managerial 
prerogatives.  In  fact,  resource  allocation  guidance  can  be  viewed  as  a form 
of  policy;  we  have  simply  chosen  to  treat  resource  variables  separately  in  the 
impact  graphs.  Other  forms  of  policy  include  plans,  strategies,  rules-of- 
thumb,  guidelines,  procedures,  decision  criteria,  and  performance  standards. 

The  common  assumption  chat  effective  management  ccntrol  must  involve 
performance  standards  is  a very  narrow  view.  Indeed,  we  believe  that  at  the 
institutional  level  of  management,  performance  st.indards  are  a relatively 
^effective  means  of  control.  Strict  performance  standards  can,  for  example, 
lead  to  distortions  in  ti.  j performance  measures  being  monitored.  The  use  of 
performance  st.indards  should,  for  the  most  part,  be  left  to  the  discretion  of 
operational-level  management. 
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IMPACT  GRAPHS 


Aircraft 

An  impact  graph  for  the  capacities  in  the  aircraft  flow  graph  (Fig- 
ure 8)  is  depicted  in  Figure  13.  While  this  diagram  appears  complicated,  it 
represents  as  macro  a level  of  detail  as  we  could  accept  without  losing  major 
aspects  of  the  Air  Force  logistics  system.  Greater  levels  of  detail  are 
possible,  of  course.  Base  maintenance  (B/M)  resources  (KilPers),  for  example, 
which  are  treated  here  as  a single  resource  variable,  could  conceivably  be 
subdivided  into  skill  levels  if  necessary.  We  have  tried  to  conform  to  cur- 
rent budget  categories  in  identifying  resource  variables.  This  may  not  be  the 
most  revealing  criterion  possible,  but  it  can  simplify  the  task  of  developing 
relationships . 

For  some  resource  variabies,  entire  flow  graphs  could  be  deveJoped 
for  better  understanding  of  the  management  of  these  reci'  s (e.g-i  flows  of 
support  equipment  and  manpowe:).  Similarly,  the  impacts  from  other  flow 
graphs  could  conceivably  be  collapsed  into  a single  resource  variable  (e.g., 
the  consumable  flow  graph  could  be  treated  as  a single  budgeted  resource). 
The  point  at  which  development  of  flow  and  impact  graphs  should  stop  must  be 
determined  by  the  managers  who  are  going  to  use  them,  subject  to  the  following 
guidelines ; 

1.  The  level  o^  detail  should  be  compatible  with  appropriate 
managerial  roles.  At  the  inscitutional  level,  this  role  should 
focus  on  broad  management  and  support  concepts  aud  philos- 
ophies . 

2.  One  additional  layer  of  detail,  beyond  that  over  which  insti- 
tutional level  management  should  exercise  control,  can  assist 
in  linking  that  level  with  the  levels  below  (e.g.,  the  Office 
of  the  ASD(MRA&L)  and  the  Offices  of  the  Military  Department 
assistant  secretaries  responsible  foi  logistics). 

So,  although  the  level  of  detail  in  these  flow  and  impact  graphs  may  exceed 
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the  managerial  responsibilities  of  the  ASD(MRA&L),  it  provides  some  consist- 
ency between  management  levels . 

We  have  chosen,  for  the  time  being,  not  to  identify  specific  policy 
variables.  Rather,  we  have  depicted  these  impacts  by  naming  the  policies  in- 
volved. The  choice  of  policy  variables  will,  to  a large  degree,  depend  on  the 
ease  with  which  relationships  between  them  and  system  capacities  can  be  quan- 
titatively developed.  Also,  only  a few  policies  are  included,  those  having 
direct  and  significant  impacts.  Some  flows,  in  fact,  are  almost  entirely 
determined  by  policy  (e.g.  , aircraft  sent  to  scheduled  maintenance).  Finally, 
the  conversion  of  policy  variables  to  comparable  resource  units  of  measurement 
may  be  advantageous  in  rendering  the  impact  graph  more  analytically  manage* 
able.  This  possibility  is  discussed  further  in  the  "Analytical  Capability" 
section  below. 

Engines 

The  impacts  of  budgeted  resources  and  selected  policy  parameters  on 
the  capacities  in  the  engine  flow  graph  are  depicted  in  Figure  14.  This  im- 
pact graph  differs  from  the  others  in  one  respect;  the  base  engine  mainte- 
nance activity  involves  numerous  flows  of  engines  (enclosed  in  the  dotted 
segment  of  the  diagram).  Because  these  flows  actually  occur  in  the  same 
maintenance  shop,  and  the  maintenance  functions  are  performed  by  the  same 
personnel,  it  is  difficult  to  identify  impacts  on  specific  flow  capacities. 
It  is  much  easier,  for  the  purpose  of  developing  relationships,  to  treat  these 
four  functions  (base  returns,  engine  installations,  engines  tor  buildup  and 
removals)  as  a whole.  The  reason  why  these  functions  are  often  separated  is 
to  allow  a complete  accounting  of  the  engine  inventory,  i.e.,  whether  they  are 
installed,  built-up  and  ready  to  be  installed,  failed  but  still  on  an  air- 
craft, failed  and  being  repaired,  or  repaired  and  ready  for  buildup  when 
necessary. 
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Exchangeables 


An  impact  graph  for  exchangeable  items  appears  in  Figure  15.  This 
impact  graph  exhibits  a different  structure  from  the  previous  two  in  th.it 
there  are  now  separate  subgraphs.  This  is  somewhat  misleading  for  two 
reasons. 

First,  all  control  variables  indirectly  affect  all  flows  through  the 
networks  in  the  flow  graphs.  The  impact  graphs  should  not  therefore  be  manip- 
ulated independently  of  their  effects  on  the  flow  graphs. 

Second,  some  control  variables  may  affect  flow  capacities  in  ways 
not  depicted  on  an  impact  graph.  For  example,  in  Figure  15,  Military  Con- 
struction (MilCon)  funds  ace  shown  as  affecting  only  the  exchangeable  inven- 
tory capacity  (warehousing  and  storage  facilities).  Of  course,  maintenance 
facilities  will  also  have  an  impact  on  the  reparable  maintenance  capability. 
We  have  chosen,  however,  not  to  depict  the  impact  of  "MilCon  S"  on  component 
repair  capacity.  The  assumption  is  that  maintenance  facilities  used  to  repair 
aircraft  are  also  used  to  repair  components.  So,  as  long  as  facilities  are 
available  for  aircraft  maintenance,  there  will  be  no  capacity  constraint  on 
reparable  maintenance.  If  aircraft  maintenance  facilities  are  not  available, 
there  will  be  no  demand  for  component  repair.  If  the  validity  of  this  as- 
sumption were  in  doubt,  a new  arrow  could  be  added  connecting  "MilCon  $"  to 
"base  repairs"  and  "depot  repairs." 

Consumables 

The  impact  graph  for  consumables  is  depicted  in  Figure  16.  Notice 
that  the  capacity  to  provide  consumable  items  affects  the  capacities  of  the 
other  three  classes  of  materiel. 

As  an  example  of  a policy  variable,  the  percentage  of  NORS  incidents 
terminated  by  WRM  could  reflect  WRM  policy.  Policy  for  using  and  relating  WRM 
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EXCHANGEABLE  IMPACT  GRAPH 


FIGURE  16 

CONSUMABLE  IMPACT  GRAPH 
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in  pescetlme  clafiaitely  affects  the  capacity  of  the  logistics  system  to  pro- 
vide spare  parts.  Of  course,  this  policy  would  change  in  time  of  war.  In 
fart,  as  the  name  implies,  WRH  represents  a reserve  capacity,  the  utilization 
of  which  is  limited  in  peacetime  by  policy. 

ANALYTICAL  CAPABILITY  OF  IMPACT  GRAPHS 
Tradeoff  Analysis 

The  primary  role  of  "resource  analysis"  is  to  assist  top-level  man- 
agement in  making  qualitative  or  quantitative  tradeoffs  between  alternative 
mixes  of  resources  and  between  alternative  strategies  for  using  them  (poli- 
cies). The  impact  graph  can  be  used  qualitatively  to  organize  one's  ideas 
about  a portlcular  tradeoff  isaue  and  communicate  them  to  others.  Quanti- 
fication makes  algorithmic  assessments  possible,  perhaps  with  the  assistance 
of  a computer  model  that  links  the  impact  graphs  to  the  flow  graphs.  In  the 
quantitative  mode,  alternatives  can  be  assessed  for  their  impact  on  capability 
(maximum  flow) . 

Impact  graphs  can  be  misleading,  however.  They  do  not,  for  example, 
make  explicit  any  interdependence  among  the  control  variables.  If  the  effect 
of  one  resource  or  policy  change  is  influenced  by  other  such  changes  intro- 
duced concurrently,  the  resulting  impact  on  the  system  may  be  very  different 
from  that  expected  for  the  original  change.  In  other  words,  impacts  from 
simultaneous  changes  in  control  variables  may  cancel  or  compound  each  other. 
Hence,  control  variables  may  I ; complementary;  changes  made  together  may  have 
a greater  impact  than  the  sum  of  the  effects  of  the  same  changes  made  separ- 
ately. Likewise,  there  may  be  some  substitution  between  control  variables;  an 
impact  may  be  realizable  by  change  in  one  of  a number  of  variables,  but  chang- 
ing more  than  one  may  not  have  any  greater  impact  than  changing  only  one. 
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Impact  graphs  also  do  not  explicitly  reflect  the  time  lag  between 
when  a change  is  implemented  and  when  its  effect  is  observed  in  the  system. 
The  issue  of  time  lags  and  associated  time  preferences  is  extremely  important 
at  the  policy  level  of  management.  It  is  at  this  level  that  the  difficult 
tradeoffs  between  capital  investment  and  current  operations  must  be  evaluated. 
Current  performance  is  very  often  sacrificed  to  permit  the  buildup  of  capacity 
in  the  long  term.  These  are  strategic  tradeoffs  with  very  significant  con- 
sequences for  both  defense  technology  and  defense  organization. 

The  quantification  of  impact  graphs  should,  therefore,  address  the 
interrelationships  of  control  variables  and  time  lags.  Such  quantification 
must  rely,  to  a great  extent,  on  "institutional  knowledge,"  the  experience  and 
judgment  of  people  who  understand  the  intricacies  of  DoD  logistics.  Our 
experience  in  Phase  2 of  this  study  demonstrated  that  historical  data,  while 
valuable  for  many  applications,  are  not  by  themselves  sufficient  to  axpose  the 
relationships  needed  to  interpret  the  significance  of  trends. 

Institutional  knowledge  is  an  invaluable  source  of  such  information 
because  the  human  mind  has  a unique  capability  to  sort  out  complex  inter- 
relationships. This  capability  ought  to  be  used  to  interpret  information 
derived  from  formal  data  collection  systems.  The  key  issue  to  be  addressed  is 
the  development  of  methodological  instruments  for  generating  data  from  insti- 
tutional knowledge.  The  remainder  of  this  subriection  discusses  briefly  the 
state  of  the  art  in  this  area  and  the  problems  associated  with  existing 
methods. 

Collecting  and  Processing  Subjective  Data:  A large  number  of 
methodological  tools  that  use  subjective  data  have  been  tested.  These  tools 
include  questionnaire  methods  (marketing  research),  content  analysis  (com- 
munication research),  Delphi  techniques  (futures  research),  and  interactive 
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computer  techniques  (operations  research).  None  of  these  methods  is  satis* 
factory  for  our  needs. 

However,  there  is  some  promising  research  on  the  deficiencies  of 
existing  methods.  The  majority  of  this  research  focuses  on  weighting  tech- 
niques and  subjective  probabilities.  Some  of  the  weighting  techniques  include 

12  3 

cross-impact  analysis,  digraph  analysis,  multidimensional  scaling,  inter- 

4 5 

pretive  structural  modeling,  and  hierarchical  analysis  and  prioritization. 

(We  have  chosen  to  use  a variation  of  Saaty's  method  in  our  hierarchical 
analysis,  discussed  in  chapter  5,  but  for  a purpose  different  from  that  in  the 
impact  graphs.)  System  dynamics  modeling,  discussed  in  chapter  3,  must  also 
often  rely  on  expert  knowledge  for  the  estimation  of  its  dynamic  parameters. 

One  problem  with  weighting  techniques  is  that  an  assumption  of 
linearity  must  be  made,  at  least  over  some  incremental  range  of  the  relation- 
ships being  considered.  A number  of  the  techniques  involve  pairwise  compari- 
sons of  the  elements  in  the  structure  selected.  While  this  provides  the 
contributor  with  a way  of  organizing  the  relationships  relative  to  each  other, 
it  also  limits  the  consideration  to  binary  relationships.  If  a set  of  vari- 
ables is,  in  fact,  highly  interrelated,  binary  relationships  may  not  be 
adequate.  The  primary  means  for  addressing  nonlinearity  and  higher  order 
relationships  in  weighting  techniques  has  been  the  introdirtion  of  subjective 
probabilities . 

Substantial  discussion  of  subjective  probabilities  is  included  in 

the  literature  on  multiple  criteria  decision-making.^  Unlike  some  multiple 

7 8 

criteria  methods,  such  as  goal  programming,  compromise  programming,  and 

9 

various  interactive  programming  techniques,  probabilistic  techniques  intro- 
duce considerations  for  uncertainty  into  the  possible  outcomes  of  a decision. 
Subjective  probabilities  have  been  introduced  into  cross-impact  analysis,  but 
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perhaps  the  most  significant  application  has  been  multiple  objective  utility 
theory. 

Utility  theory  requires  the  identification  of  a utility  scale  or 
metric  (usually  dollars)  upon  which  alternatives  can  be  assessed.  In  our 
case,  this  implies  the  conversion  of  policy  variables  into  some  equivalent 
resource  value.  This  is  a reasonable  manipulation,  as  policy  generally  has 
substantial  implications  for  resource  management.  In  fact,  institutional 
management  often  exercises  influence  through  policy,  which  affects  the  way 
resources  are  managed  at  the  operational  level,  as  opposed  to  changing  the 
resources  allocated  sc. 

The  problem  with  subjective  probability  approaches  to  complex  policy 
situations  is  that  the  uncert.ainty  experienced  may  not  be  of  the  type  that  can 
be  treated  with  probability  assessments.  Rather,  it  may  fall  into  the  cate- 
gory of  "primary"  uncertainty,  where  one  is  Ignorant  not  only  of  the  proba- 
bility distributions  of  possible  outcomes,  but  also  of  the  dimensions  (i.e., 
significant  variables)  of  possible  outcomes.  More  generalized  methi.  that 
do  not  restrict  the  specification  of  uncertainty  to  subjective  probabi li : ies 

have  been  suggested  as  a means  of  dealing  with  such  complex  situations.  In 

12  13 

this  category  are  fuzzy  set  theory  and  constraint  analysis.  Empirical 
applications  of  these  theoretical  developments,  however,  are  not  extensive. 

Again,  one  of  the  most  challenging  management  research  needs  is  the 
development  of  methodological  instruments  to  generate  empirical  data  compati- 
ble with  these  more  generalized  methods.  Some  promising  efforts  in  this 

direction  are  based  on  interactive  simulation  and  gaming,  and  the  use  of  tech- 

14 

oologies  like  computer  conferencing. 

A final  note  on  the  topic  of  generalized  methods  is  appropriate. 
Traditional  analytical  and  modeling  techniques  have  been  very  successfully 
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applied  at  the  operational  levels  of  management.  By  taking  an  engineering 
approach  to  modeling,  the  developers  of  these  techniques  have  been  able  to 
attain  high  degrees  of  accuracy  in  parameter  estimation  and  in  empirical 
validation.  But  the  engineering  approach  sacrifices  theoretical  scope  and 
generality.  At  the  policy  level,  a broad  theoretical  scope  that  allows  the 
reevaluation  of  model  (and  system)  structures  is  needed.  To  achieve  this  kind 
of  scope  requires  an  acceptance  of  limitations  on  parameter  estimation  and  on 
model  validation.  Very  approximate,  even  qualitative  (if  necessary),  infor- 
mation must  be  satisfactory.  Model  validation,  in  this  context,  includes 
demonstration,  managerial  participation,  and,  eventually,  implementation. 
This  broader  approach  is  much  more  compatible  with  the  role  of  top-level 
management  than  is  the  traditional  engineering  approach. 

Risk  Analysis 

A by-product  of  tradeoff  analysis  is  the  opportunity  for  risk  analy- 
sis. When  a relationship  cannot  be  developed  as  a one-to-one  functional 
correspondence  between  a state  variable  and  the  control  variables,  the  impacts 
of  the  control  variables  are  uncertain.  If  this  uncertainty  can  be  expressed 
as  a probability  distribution,  utility  theory  can  be  used  to  discount  the 
alternative  impacts  with  respect  to  their  relative  "riskiness."  When  the 
probability  distribution  is  not  known,  a uniform  distribution  can  be  assumed, 
and  the  ratio  of  the  variance  to  the  mean  used  as  a risk  discount  factor. 

When  neither  the  probability  distribution  nor  the  precise  boundaries 
on  the  distribution  of  pos.9ible  impacts  are  known,  fuzzy  set  theory  can  sume- 
times  be  helpful.  Clark  and  Pipino  have  demonstrated  that,  with  respect  to 
uncertainty  considerations,  utility  theory  is  a restricted  form  of  the  more 
generalized  fuzzy  set  theory.  Hence,  the  principles  of  utility  theory  can 
be  applied  to  fuzzy  uncertainty.  The  use  of  risk  discounting  may  not  be  the 
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best  way  to  treat  risk,  but  at  present  it  is  the  state  of  the  art.  When  risk 
discounting  is  combined  with  time  discounting,  the  methodological  problems 
become  more  severe.  Some  work  in  this  area,  however,  appears  promising. 

The  application  of  risk  analysis  to  the  impact  graphs,  in  whatever 
form,  allows  management  to  hedge  in  situations  where  a decision  based  solely 
ou  expected  (or  most  probable)  outcomes  could  result  In  undesirable  or  even 
disastrous  consequences,  even  though  the  perceived  probabilities  of  such  are 
low.  When  very  low  probabilities  are  associated  with  highly  undesirable 
consequences,  the  situation  is  often  referred  to  as  one  with  significant 
"downside  risk."  Management's  avoidance  of  downside  risk  has  often  been 
observed,  but  there  has  been  little  analytical  treatment  of  it.  This  is 
another  research  issue  that  needs  to  be  addressed. 

Sensitivity  Analysis 

As  previously  mentioned,  fully  quantified  flow  and  impact  graphs 
could  be  adapted  to  a computer  model.  Such  a model  could  enable  a manager  to 
evaluate  the  sensitivity  of  logistics  system  parameters  to  changes  (inten- 
tional or  otherwise)  in  resources  and  policies.  For  this  type  of  mr.cro  model 
to  be  effective,  managers  themselves  must  participate  in  supplying  input  and 
in  assessing  output. 

Model  development  efforts  should  emphasize  a sound,  yet  tractable, 
structure,  rather  than  precise  parameter  estimation.  Insights  into  the  basic 
structure  of  a logistics  system  are  possible  even  though  the  output  estimates 
are  rough.  The  power  of  a computer  model  is  its  ability  to  specify  the  impact 
of  a given  set  of  resource  and  policy  variables  on  support  capability,  by 
calculating  the  maximum  flows  in  the  flow  graphs.  High  degrees  of  sensitivity 
might  suggest  a need  for  closer  control  of  the  control  variables  or  for  moni- 
toring of  system  parameters  exhibiting  high  variability. 


APPLICATION  OF  IMPACT  GRAPHS 

Two  simple  examples  of  the  development  of  relationships  in  an  impact 
graph  are  presented  here.  The  first  involves  a weighting  scheme,  and  the 

second  an  incremental  estimation  scheme.  These  techniques  should  not  be 
regarded  as  recommended  methods.  They  serve  only  to  illustrate  the  problems 

of  using  institutional  knowledge  as  an  information  source  and  to  emptasize  the 

need  for  further  research. 

An  Example  Using  a Weighting  Technique 

For  this  e,xample,  v?e  assume  a simple  impact  graph  as  shown  in 

Figure  17.  C is  a flow  capacity  on  an  arc  in  a flow  graph  (not  depicted).  Rj, 
R., , and  R^  are  the  control  variables  that  management  can  manipulate  to  effect 
a change  in  the  state  variable,  C.  For  this  e.xaiiiple,  we  assume  K.|.  K2 , 

and  R^  are  resources  and  are  constrained  only  by  budget  limit,  B.  i,n 
practice,  of  course,  the  amount  of  flexibility  to  change  resource  levels  is 
very  small.  Hence,  a more  accurate  formuiatioii  might  consider  only  minor 
incremental  changes  from  current  funding  levels. 
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The  mix  of  R^,  R^,  and  R^  produces  a C,  which  is  not  necessarily 
unique.  The  reason  that  C is  not  unique  is  that  there  may  be  other  variables 
(particularly  exogeneous  variables)  not  included  in  the  analysis,  but  having 
an  impact  on  C.  These  variables  are  not  included  either  because  they  are  not 
controllable,  or  because  we  have  not  observed  them  to  have  a significant 
impact,  or  because  they  are  difficult  to  measure.  In  addition,  the  precise 
relationship  between  resources  (and  policies)  and  capacities  may  be  very  dif- 
ficult to  derive  if  the  variables  are  non-linearly  interrelated. 

Due  to  tnif!  complexity,  we  need  ways  to  simplify  the  quantitative 
specification  of  the  relationship.  In  general  terms,  the  relationship  i®; 

C = (R^,  R2.  R3) 

where  is  the  relation.  The  simplification  we  will  discuss  here  involves  the 
assignment  of  weights  to  each  resource  to  indicate  the  relative  impact  of  that 
resource  over  some  relevant  range  of  values.  The  formulation  of  this  is; 

Maximize 

subject  to: 


C = WjR^  + W2R2  + WjR^ 


Rj  i r^ 


R3  i r^ 

R3+R2+R3  = B 

where,  for  i ~ 1,  2,  3,  the  w^  are  the  weights  and  are  the  points  at  which 
another  resource  becomes  more  effective.  B i.s  the  total  budget  constraint, 
in  this  example,  " 

W ^ W >1/ 

1 2 3 

we  would  allocate  money  first  to  R^  (until  we  reached  1 , then  to  R,, , and 


An  alternative  approach,  which  introduces  some  nonlinearity  into  the 
analysis,  involves  the  divison  of  B into  small  intervals.  Weights,  in  this 
case,  are  established  not  only  for  each  resource  but  also  for  each  respective 
interval.  One  way  to  do  this  is  to  assign  weights,  w^j^,  for  each  resource 
where  k represents  the  number  of  applications  of  So,  if  is  selected 

for  the  first  interval,  it  is  because  is  greater  than  any  other  w^^.  If 
R^  is  also  selected  for  the  second  interval,  it  is  because  greater  than 

the  weight  of  the  first  application  of  any  other  resource,  i.e.,  any  w^j,  i f 

1. 

As  an  example,  divide  B into  five  equal  intervals: 


Assume  the  following  weights: 


”11  “ 

.52 

”21  "" 

.43 

Wjj  = .35 

'^12  “ 

.37 

W22  = 

.32 

W22  = .23 

Wj3  = 

.20 

'^23  ^ 

. 17 

W33  = .Ih 

Le*'  B = $b  billion  and  assume  upper  constraints  on  each  resource  of: 

Tj  = $1.5  billion 
r2  = $3.5  billion 
= $2  billion 

For  interval  1,  the  first  $1  billion,  the  allocation  goes  to  R1 
because  = .52  is  greater  than  any  other  For  interval  2,  the  al- 
location, $1  billion,  goes  to  R2  for  its  W2j  = In  interval  3,  the  first 

$.5  billion  goes  to  Rj(Wj2  = .371,  and  the  second  $.5  billion  goes  to  R^  tw^^ 
= . 35  J . This  is  because  R^  has  reached  its  maximum  r^  = 1.5.  The  first 
$.5  billion  of  interval  4 goes  to  = .35)  and  the  second  $.5  billion 


4-22 


taaiiiiyiMbiLi'ggHBfi 


goes  to  = .32).  The  first  $.5  billion  of  interval  5 goes  to  R2  (^22  ~ 
.32)  and  the  second  $.5  billion  goes  to  Cw,2  = .23).  The  calculation  for 
the  state  variable,  C,  is: 

C = .52(1)  + .43(1)  + .35(.5J  + .35(1) 

+ .32(1)  + .23(.5)  = 1.91 

If  the  weights  are  established  on  a scale  of  zero  to  one,  the  1.91  would  have 
to  be  multiplied  by  some  unit  conversion  factor  to  get  a measure  of  C.  Graph- 
ically, the  resulting  relationship  looks  like  that  in  Figure  18. 


>2  »3  M >5 


BUDGET  (BILLIONS) 

While  this  method  accounts  for  more  complexity  than  did  the  simple  weighting 

method,  it  still  does  not  address  the  following: 

two  equal  weights  in  a particular  interval 

- the  dependence  of  a weight  on  the  allocations  of  all  resources 
which  preceded  it 

complementarity  and  substitutability  between  resources. 

The  first  problem  can  be  handled  by  making  the  intervals  sufficiently  small  so 
that  the  choice  between  the  two  equally  weighted  variables  is  inconsequential. 
Human  judgment  might  also  be  used.  The  second  problen;  could  be  handled  by 
allocating  resources  to  an  interval  prior  to  establishing  weights  for  the  ne.xt 
interval.  The  third  problem  requires  the  identification  of  those  variables 
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which  are  complementary  and  should,  therefore,  be  allocated  together,  and 
those  variables  which  are  substitutes,  and  should  not  be  allocated  together. 
Again,  some  human  judgment  is  required. 

The  real  problem  with  weighting  methods  arises  when  we  add  more 
state  and  control  variables.  The  linkages  evident  in  Figures  13  through  16 
complicate  the  situation  considerably.  If,  in  addition,  we  introduce  time 
lags  to  indicate  that  some  variables  take  longer  to  have  an  effect  than 
others,  the  number  of  weight  combinations  we  would  have  to  establish  becomes 
astronomical. 

The  use  of  minimum  and  maximum  estimates  of  marginal  changes  in  a 
state  variable  from  its  current  state,  for  given  changes  in  control  variables, 
provides  an  alternative  approach,  which  requires  substantially  less  infor- 
mation than  the  above  weighting  technique.  The  resulting  relationships, 
however,  will  be  much  more  approximate.  If  this  method  is  used,  the  question 
that  arises  is:  What  degree  of  approximation  is  acceptable  for  broad 
policy-making  and  resource  guidance? 

An  Example  Using  an  Incremental  Estimating  Technique 

The  following  example  is  similar  to  the  weighting  techniques;  but 
rather  than  assign  weights  to  represent  the  strength  of  relationships,  this 
time  we  will  deduce  the  relationship  by  assigning  resources  or  groups  of 
resources  (resource  sets)  for  allocation  and  then  estimate  the  corresponding 
change  in  the  state  variable.  Figure  19  is  the  simple  impact  graph  used  in 
this  example. 

To  use  this  method,  a number  of  assumptions  must  be  made.  First, 
for  each  set  of  estimates,  a time  horizon  must  be  specified.  The  estimates 
must  then  be  solicited  for  a range  of  time  horizons.  The  significance  of  the 
time  horizon  is  that  in  selecting  resourcr  sets,  no  effects  beyond  one  year 
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ave  consid'?red.  S^jconi,  dii  upper  limit  on  the  funding  for  a particular  state 
variable  is  assumed.  Third,  it  is  assumed  that  Defense  managers  and  operators 
will  conform  to  Defense  policy  guidance  with  respect  to  resource  utilization 
and  management. 

This  incremental  estimating  technique  allows  for  interdependence 
among  resources  (control  variables),  including  complementarity  and  substitut.!- 
bility.  But  it.  .also  requires  (1)  greater  exercise  of  judgment  with  respect  to 
identifying  those  resources  that  are  most  critical  to  improving  .i  state  vari- 
able, and  (2)  the  knowledge  needed  to  estimate  corresponding  changes  in  the 
state  variable.  For  the  .st.ate  variable  depicted  in  Figure  18,  Base  Aircrait 
haincenance,  Table  2 provides  hypothetical  numbers  fur  a one-year  time  horizon 
and  an  upper  funding  limit  of  36  billion. 


I 
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TABLE  2.  HYPOTHETICAL  RELATIONSHIPS  BETWEEN  BASE  AIRCRAFT  MAINTENANCE 

RJNDING  LEVELS  AND  CAPACITY 


Time  Horizon:  1 Year 
Upper  Limit:  $6  Billion 


Increment 

No. 

Resource 

Sets 

Increment 

Size 

Resource 

Ratio 

Estimate 
of  Change  in 

State  Variable 

Base 

^1^2^3^4^5 

$ 4B 

8:1:4:2:1 

600,000  aircraft/yr. 

1 

.5B 

1 

17,000 

2 

**3^4 

.3B 

2:1 

8,000 

3 

.6B 

1 

10,000 

4 

Rl®2 

.4B 

3:1 

S7o5o 

5 

«3 

.2B 

1 

2,000 

Upper  Limit 

$ 6B 

643,000 

In  this  case,  any  resource  that  takes  more  than  a year  to  have  an  impact  will 
be  excluded  from  selection.  When  tables  for  three  or  four  time  horizons  have 
been  developed,  time  discount  factors  (or  some  other  metnod  for  treating  time 
preferences)  can  be  applied.  A composite  resource  allocation  and  correspond- 
ing state  variable  estimates  can  then  be  calculated. 

To  interp..ot  this  table,  we  begin  with  the  left-hand  column.  The 
first  row  represents  a funding  "Base"  over  which  there  is  no  control.  These 
funds  have  been  committed  by  requirements  of  irrevocable  decisions  already 
made.  In  this  example,  $4  billion  is  considered  uncontrollable.  The  next 
five  rows  represent  funding  increments  to  be  added  to  the  base  in  order  of 
decreasing  priority.  In  this  example,  R^,  exchangeable  items,  was  determined 
to  be  the  most  critical  until  $0.5  billion  has  been  allocated  at  which  time 
R^,  consumable  items,  becomes  equally  important.  The  resource  set,  R^R^i 
should  be  allocated  together  to  get  the  full  impact  of  available  funds.  This 
may  be  a result  of  complementarity  between  resources  or  of  equally  important 
resources . 
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The  column  labeled  "Resource  Ratio"  is  a specification  of  how  much 
cf  each  resource  is  allocated  in  a particular  increment.  In  increment  2,  for 
example,  two-thirds  of  the  $0.3  billion  goes  to  R^  and  one-third  to  R^.  The 
right-hand  column  is  the  estimate  of  the  expected  change  in  the  state  vari- 
able, the  capacity  of  Base  Aircraft  Maintenance  to  process  aircraft,  measured 
in  aircraft  per  year.  When  these  point  estimates  are  connected  and  put  into 
graphical  form,  the  relationship  appears  as  in  Figure  20. 

nsuRE  20 

GRAPHICAL  RELATIONSHIP  GENERATED  BY  TABLE  2 


The  major  problem  with  this  incremental  estimating  technique  is  the 
difficulty  of  generating  the  estimates.  Such  estimates  should  come  from  indi- 
viduals with  both  a macro  perspective  and  a detailed  knowledge  of  where  cur- 
rent problems,  bottlenecks,  and  opportunities  for  improvement  lie,  On  the 
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other  hand,  the  types  of  estimates  needed  are  not  unlike  many  of  those  re- 
quired as  supporting  material  in  annual  budget  submissions. 

Modifications  to  this  method  might  alleviate  the  estimation  problem 
to  some  extent.  Rather  than  requiring  direct  estimates  of  changes  in  a state 
variable,  it  might  be  easier  to  estimate  changes  in  other  parameters,  which 
can  then  be  used  to  calculate  a change  in  the  state  variable.  The  simple 
equations  suggested  in  chapter  3 might  serve  this  purpose.  It  might  also  be 
possible  to  use  existing  modeLs  to  calculate  changes  in  a state  variable. 

Another  modification  would  be  to  reduce  the  requirement  for  point 
estimates  from  Individual  respondents.  A range  of  possible  values  (i.e., 
thresholds)  would  be  easier  to  arrive  at.  This  would  introduce  uncertainty 
into  the  analysis  and  allow  for  consideration  of  risk  tradeoffs. 

Finally,  rather  than  beginning  with  a "Base"  funding  level,  it  might 
be  reasonable  to  begin  at  the  current  funding  level  and  then  search  in  both 
directions  for  possible  incremental  changes.  The  method  used  in  the  example 
is  more  compatible  with  the  concept  of  Zero  Base  Budgeting  in  that  it  requires 
a justification  of  the  base.  On  the  other  band,  starting  with  the  current 
situation  is  probably  more  compatible  with  the  way  resource  allocation  is 
actually  practiced,  and  may  also  be  easier  to  treat  analytically. 

INSTITUTIONAL  KNOWLEDGE  AlfD  RESOURCE  ANALYSIS 

There  is  a major  need  for  research  in  the  area  of  policy  analysis  to 
develop  methodological  tools  that  can  elicit  responses  from  individuals  con- 
cerning relationships  between  state  and  control  variables.  We  believe  that 
significant  information  about  these  relationships  is  part  of  the  existing 
institutional  knowledge  within  DoD.  What  is  needed  is  not  only  appropriate 
means  for  collecting  and  analyzing  this  information,  Duc  also  creative  ways  of 
displaying  it.  Improved  channels  of  communication  also  need  to  be  identified. 
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In  chapter  5,  "Hieri»rchical  Analysis,"  we  present  a technique  for  col- 
lecting and  processing  judgmental  data  with  respect  to  logistics  goals  and 
objectives.  We  do  not,  however,  believe  that  the  same  technique  can  be  used 
to  adequately  quantify  the  relationships  in  resource  analysis.  The  method  of 
pairwise  comparisons  relied  on  in  hierarchical  analysis  is  not  sufficient  to 
treat  the  high  degree  of  interdependency  common  among  very  aggregate  resource 
and  policy  variables. 

At  its  present  state  of  development,  as  described  in  this  chapter, 
resource  analysis  provides  a structure,  in  the  form  of  impact  graphs,  which 
can  assist  in  the  process  of  assessing  alternative  re.soi'rce  allocations  and 
policy  decisions.  This  structure  specifically  allows  cons ' deration  for  the 
interdependencies,  i.e.,  the  higher-c  ‘der  relationships,  among  control 
variables,  something  that  traditional  economic,  optimization,  and  graphical 
structures  do  not  allow.  Thus,  resource  analysis  can  be  a valuable  tool  for 
facilitating  discussion  and  debate  on  very  complex  issues  of  policy  and  on 
budget  and  policy  formulation.  It  can  also  serve  as  an  information  filter  by 
providing  a context  for  interpreting  logistics  data. 


5.  HIERARCHIAL  ANALYSIS 


STRUCTURAL  DESCRIPTION 

Flow  analysis  (chapter  3)  and  resource  analy  .is  (chapter  4)  are  tools 
for  structuring  the  operational  aspects  of  a logistics  system  and  for  eval- 
uating potential  changes  in  its  structure.  They  provide  individual  managers 
and  administrators  with  a way  to  organize  both  the  information  they  receive 
and  their  ovm  ideas  about  the  system  they  are  managing.  But  these  tools 
do  not  address  differences  between  individual  managers,  e.g.,  how  they  per- 
ceive and  assess  the  system,  or  where  they  believe  the  most  critical  problems 
and  the  greatest  potential  for  improvement  lie.  These  differences  represent 
management  issues.  Hierarchical  analysis  is  a tool  designed  to  assist  in 
resolving  such  differences  and,  more  specifically,  in  structuring  the  goals 
and  objectives  to  be  imposed  on  the  operational  logistics  system. 

Many  opportunities  exist  for  creative  research  in  the  development 
of  techniques  to  carry  out  the  function  of  hierarchical  analysis.  The  exist- 
ing techniques  all  have  certain  methodological  1 jmitat j ons . However,  we 
believe  that  a hierarchical  structure  provides  an  extremely  powerful  means 
of  reducin.'*  the  apparent  complexity  of  large  systems  like  DoD  logistics, 
regardless  of  the  specific  technique  used  to  analyze  that  structure.  The 
technique  we  selected  was  developed  and  applied  to  issues  of  policy  by 
Saaty^  and  involves  pairwise  comparisons  of  elements  at  each  level  of  a 
hierarchy,  using  a scaie  of  relative  importance.  Through  simple 
calculations,  priorities  for  Logistics  goals  and  objectives  can  be 
generated.  Despite  certain  limitations,  discussed  later  in  the  chapter, 
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we  believe  this  technique  represents  the  state  of  the  art  in  the  structur- 
ing of  multiple  and  conflicting  goals  and  objectives.  It  also  provides 
an  essential  element  of  our  overall  framework,  namely,  a mechanism  for 
facilitating  discussion  and  debate  on  logistics  management  issues. 

This  chapter  describes  the  technique  and  offers  a numerical  application 
for  illustrative  purposes.  The  mathematical  development  and  theoretical 
support  for  this  technique  is  presented  in  the  appendix. 

Hierarchical  Development 

The  information  processing  limitations  imposed  on  individual 
managers  and  on  organizations  provide  the  rationale  for  using  a hier- 
archical structure.  By  reducing  complex  problems  and  phenomena  into 

subproblems  and  subphenomena,  and  those  into  further  subdivisions, 
complexity  can  be  reduced  to  a manageable  level. ^ The  development  of 

a hierarchy  requires  the  identification  of  subsystems  (i.e.,  clusters 

of  variables),  which  are  relatively  (or  conditionally)  independent  of 

each  other.  These  subsystems  (or  clusters)  form  the  elements  of  a level 
of  the  hierarchy  and  are  related  to  each  other  only  through  the  elements 
of  the  next  higher  level  (aggregations  of  subsystems).  A system  which 
can  be  hierarchically  structured  is  said  to  be  "nearly  decomposable." 

When  a system  that  is  not  nearly  decomposable  is  hierarchically 
structured,  some  of  the  interrelationships  between  subsystems  (i.e,, 

the  elements  of  a particular  level  of  the  hierarchy)  may  be  ignored. 
Some  inconsistency  may  result  from  the  technique  presented  here  if  certain 
interrelationships  are  ignored.  A certain  amount  of  iiucnsistency 
is  acceptable,  but  too  much  can  render  the  priorities  calculated  very 

sensitive  to  changes  (or  perturbations)  in  importance  factors.  This 
problem  is  discussed  in  the  appendix. 
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For  our  purposes,  the  levels  of  a hierarchy  correspond  to  distinct 
areas  of  managerial  influence  and  control.  There  are  no  strict  procedures  for 
developing  a hierarchy,  only  guidelines.  But  if  hierarchical  analysis  is  to 
be  effective,  DoD  administrators  and  logistics  managers  themselves  must  parti- 
cipate in  the  development  of  an  appropriate  structure  and  in  the  assignment  of 
priorities  within  it.  Only  if  the  structure  is  agreeable  to  all  the  parties 
involved  can  the  tool  fulfill  its  purpose  of  facilitating  discussion,  debate, 
and  communications  on  policy  issues. 

In  the  hierarchy  we  offer  as  an  illustration,  the  apex  corresponds 
to  an  overall  logistics  purpose,  which  can  be  stated  simply  as  "the  logistics 
support  of  national  defense  systems."  At  the  second  level  of  the  hierarchy 
are  global  logistics  objectives.  These  global  objectives  reflect  aspects  of 
"readiness,"  and,  as  such,  are  broad  concepts.  They  are  not  directly 
measurable,  but  they  are  distinct  objectives  that  managers  can  associate  with 
logistics.  The  third  level  of  the  hierarchy  corresponds  to  the  structural 
aspects  of  the  logistics  system.  The  elements  of  this  level  are  logistics 
activities.  The  fourth  and  final  level  consists  of  policy  objectives,  which 
each  activity  pursues  in  mahing  its  contribution  to  the  global  objectives. 
This  level  corresponds  to  the  desired  performance  of  the  logistics  system. 
Policy  objectives  ace  generally  measurable. 

Many  hierarchies  are  possible,  and  many  levels  of  detail  can  be 
added  if  necessary.  One  of  the  criteria  for  a hierarchical  structure  Ls  that 
it  should  be  no  more  detailed  than  is  necessary  for  its  purpose. 

The  appropriate  level  of  detail  for  a particular  level  of  management 
La  a difficult  question.  On  the  one  hand  (as  i.n  resource  analysis),  the  level 
of  detail  must  be  sufficient  to  provide  continuity  and  ensure  consistency 
between  management  levels.  On  the  other  hand,  excessive  detail  inter! eres 


with  the  organization  and  simplification  of  complex  policy  issues.  A hier- 
archy with  more  than  four  or  five  levels  of  detail  becomes  very  time-consuming 
to  quantify,  as  administrative  personnel  must  argue  out  each  importance  factor 
individually.  Further,  for  an  element  at  a particular  level  to  have  more  than 
six  or  seven  elements  associated  with  it  at  the  next  level  presents  some 
methodological  problems  when  the  scale  of  relative  importance  has  only  five 
operationally  defined  factors.  (The  total  of  nine  factors  does,  however, 
allow  some  flexib.' lity . ) 

In  the  following  section,  we  present  an  examp.le  of  a logistics 
hierarchy  for  the  Air  Force.  The  level  of  detail  goes  beyond  that  necessary 
for  the  OSD  institutional  role  as  we  have  described  it.  In  fact,  it  is 
probably  more  appropriate  to  the  top  management  role  in  the  Air  Force  itself. 
The  OSD  role  is  more  one  to  assess  all  three  Military  Departments  and  examine 
inter-Service  possT  i.lities  for  alternative  logistics  support  concepts. 
However,  the  additional  level  of  detail  provides  the  scope  necessary  to  under- 
stand the  structure  and  operation  of  the  logistics  systems  within  each 
Service.  That  understanding  is  necessary  to  facilitate  communications  and 
coordination  between  OSD  and  the  Services. 

Priority  Scaling 

When  a hierarchy  has  been  constructed  and  agreed  upon,  the  next  step 
is  quantitative  comparison  of  the  elements  in  that  hierarchy,  level  by  level. 
To  do  this,  a scaling  technique  must  be  selected.  The  tui.hnique  used  by  Saaty 
involves  pairwise  comparisons  of  elements  at  one  level  of  the  hierarchy  with 

3 

respect  to  their  importance  for  elements  at  the  next  higher  level.'  The 
importance  scale  used  is  shown  in  Table  3. 
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The  choice  of  a scale  with  niae  factors  is  based  on  psychological 
research  that  has  demonstrated  that  the  human  mind  has  difficulty  in  dis- 
criminating among  elements  on  scales  with  any  more  than  seven,  plus  or  minus 
two,  degrees  of  discrimination  (see  appendix.)  Only  five  of  the  nine  factors, 
however,  are  associated  with  a verbal  description.  The  other  four  are  used 
for  compromising  between  any  two  adjacent  verbal  descriptions.  Reciprocals 
are  used  as  the  reverse  importance  factors.  That  is,  if  element  A is  given 
an  importance  of  9 over  element  B,  element  B has  an  importance  factor  of 
1/9  of  element  A. 


TABLE  3.  IMPORTANCE  SCALE 


Scaling  Factor 

Explanation 

1 

Equal  Importance;  Indifference 

3 

Weak  Importance  of  One  over  Another 

5 

Essential  or  Strong  Importance 

7 

Demonstrated  Importance 

9 

Ab.aolute  Importance 

2, 4, 6, 8 

Intermediate  Values  between  the  Two 
Adjacent  Factors;  Used  for  Compromise 

Reciprocals 

If  Element  I has  One  of  the  above 
Numbers  Assigned  When  Compared  to  J, 
Then  J Has  the  Reciprocal  Value  When 
Compared  to  I 

After  importance  factors  are  established,  priorities  are  cal- 
culated using  simple  matrix  manipulations.  We  present  an  example  of  these 
calculations  in  the  application  section  of  this  chapter. 

Two  procedures  can  be  used  to  establish  importance  factors.  The 
first  is  for  each  manager  to  establish  individual  factors.  These  individual 
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results  would  then  be  compared  for  discrepancies,  which  in  turn  would  suggest 
issues  for  debate.  Group  discussion  should  be  aimed  at  resolving  the  dif- 
ferences and  arriving  at  a consensus  on  these  factors.  The  second  procedure 
is  for  managers  to  arrive  at  importance  factors  through  a group  process. 
Discussion  and  debate  would  precede  the  establishment  of  each  individual 
factor. 

Many  reasons  for  individual  differences  can  be  postulated.  Among 
them  are:  differences  in  definitions  of  the  elements  of  the  hierarchy,  and 
the  context  within  which  they  are  viev;ed;  differences  in  individual  percep- 
tions of  the  purpose  of  the  exercise;  and  differences  in  the  meaning  indivi- 
duals associate  with  the  importance  scale.  These  sources  of  variability 
should  be  addressed  by  clarifying  ambiguities  prior  to  assigning  importance 
factors.  Other  sources  of  variability  include:  different  perceptions  of  the 
logistics  system,  its  problems,  bottlenecks,  and  opportunities  for  improve- 
ment; different  experiences  with,  and  exposure  to,  logistics  operations;  and 
different  functional  roles  and  personal  interests.  The  airing  aud  debating  of 
these  differences  leads  to  mutual  learning  by  the  participants,  a systemwide 
perspective,  and  possibly  the  identification  of  Innovative  alternatives. 
AN  ATR  FORCE  LOGISTICS  HIERARCHY 

Figure  21  is  an  example  of  a hierarchy  for  Air  Force  logistics.  While 
National  Defense  is  shown  at  the  top  of  the  hierarchy,  for  the  purposes  of  our 
example,  the  hierarchy  begins  with  Logistics . Ideally,  the  hierarchy  should  be 
used  for  all  defense  functions,  and  even  by  top-level  administrative  officials 
for  all  Federal  Government  activities.  But  because  the  scope  of  our  study  is 
limited  to  DoD  logistics  management,  we  have  assumed  the  existence  of  some 
higher-level  process  for  determining  the  relative  importance  of  logistics  to 
national  defense,  and  of  national  defense  to  the  Federal  Government. 


5-6 


AN  AIR  FORCE  L06!STICS  HIERARCHY 
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At  the  next  level  of  the  hierarchy,  below  Logistics  are  Global  Logistics 


Objectives . The  terms  chosen  to  represent  these  objectives-“Peacetime 
Materiel  Readiness  and  Sustainability — correspond  to  the  "omnibus  issues" 
appearing  in  the  FY  1978  logistics  issue  paper.  They  represent  a subdivision 
of  the  contribution  of  logistics  to  National  defense. 

Air  Force  Logistics  Activities  are  identified  at  the  next  level.  In  our 
example,  these  activities  correspond  to  nodes  on  the  flow  graphs.  The  impor- 
tance placed  on  different  logistics  activities  is  one  way  of  highlighting 
alternative  support  concepts.  Evaluation  of  support  concepts  is  an  important 
role  of  tup-level  management  in  the  Military  Departments  and  is  also  relevant 
to  the  OSD  role  in  establishing  a balance  among  all  DoD  logistics  activities. 

' bp  bottom  level  of  our  example  are  Air  Force  Policy  Objectives , which 
each  lo  's  activity  pursues  or  attempts  to  satisfy  in  making  its  contribu- 
tion to  the  total  logistics  effort.  The  priorities  that  management  places  on 
these  objectives  reflect  their  perceptions  of  the  importance  of  each  policy 
objective  to  the  global  objectives.  Such  perceptions  should  indicate  where 
current  problems  exist,  where  the  most  cost-effective  opportunities  are 
located,  and  also  where  managerial  preferences  for  change  lie.  This  level  of 
the  hierarchy  is  probably  a level  of  detail  below  that  appropriate  to  the  top 
level  of  OSD,  where  the  focus  should  be  more  on  the  structure  of  the  logistics 
system  than  on  its  performance.  The  performance  level  is  included  to  provide 
the  continuity  and  scope  necessary  to  ensure  coordination  between  institu- 
tional and  operational  management. 

ANALYTICAL  CAPABILITY  OF  HIERARCHICAL  ANALYSIS 
Issue  Analysis 

Policy  issues  generally  evolve  from  situations  of  conflict.  Con- 
flict may  represent  disagreements  not  only  over  the  best  means  of  achieving 
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prescribed  objectives,  but  also  over  the  objectives  themselves.  The  advantage 
of  structuring  objectives  and  policies  and  associating  them  with  logistics 
activities  is  that  points  of  conflict  can  be  identified.  With  the  prior- 
itization procedure,  some  of  the  conflicts  may  be  resolved  without  debate. 
Others  will  require  considerable  discussion,  bargaining,  and  compromise. 

The  rationale  behind  hierarchical  analysis  is  not  that  it  will 
resolve  policy  issues.  Rather,  it  can  provide  a mutually  agreeable  frame- 
work for  communication  between  conflicting  parties.  Conflicts  arising  from 
misunderstanding  or  ignorance  are  generally  easier  to  resolve  than  those 
resulting  from  different  interests  (political,  bureaucratic,  or  otherwise) 
and  different  perspectives  on  appropriate  defense  strategies. 

In  these  latter  conflicts,  however,  the  institutional  level  of 
management  can  and  should  make  a major  contribution.  The  operational  levels 
manage  technological  systems,  like  inventories,  maintenance,  and  trans- 

portation of  materiel.  The  policy  levels,  on  the  other  hand,  manage  socio- 
technical  systems,  including  management  itself.  This  institutional  function 
can  best  be  performed  by  implementing  more  effective  channels  of  communi- 
cation and  encouraging  constructive  debate  among  conflicting  interests. 

"More  effective  channels  of  communication"  does  not,  however,  translate  into 
a larger  quantity  of  information  flowing  to  OSD.  Rather,  it  refers  to  a more 
meaningful  structure  for  interpreting  that  information. 

An  example  of  an  issue  appropriate  for  OSD  consideration  would  be 
the  degree  of  centralization  or  decentralization  of  logistics  activities. 
Centralization  would  be  reflected  by  greater  emphasis  on  depot  maintenance 
and  central  supply,  decentralization  by  greater  emphasis  on  base  maintenance 
and  base  supply.  Another  such  issue  would  be  the  degree  of  component  re- 
pairability  designed  into  new  weapon  systems.  Procurement  of  reparable  items 

5-9 


implies  a more  labor-intensive  organization,  requiring  emphasis  on  maintenance 
activities.  Procurement  of  consumable  items  implies  a more  capital-intensive 
organization,  requiring  emphasis  on  supply  and  industrial  base  activities. 
These  types  of  issues  impinge  directly  on  national  defense  strategy  and  have 
both  inter-Service  and  intra-Service  implications.  They  affect  resource 
allocation,  policy  formulation,  and  the  effectiveness  of  the  logistics  system 
in  performing  its  support  role. 

Priority  Analysis 

The  successful  use  of  hierarchical  analysis  (i.e.,  the  assignment  of 
importance  factors  to  ail  elements  in  the  hiera’-chy)  results  in  a priority 
ordering  of  the  elements  at  each  level  of  the  hierarchy.  Furthermore,  the 
method  ensures  the  preservation  of  priorities  throughout  the  hierarchy.  The 
mathematical  foundations  of  the  method  are  presented  in  che  appendix  and  are 
not  discussed  here.  A brief  example,  however,  is  presented  in  the  applica- 
tions section. 

The  numbers  generated  by  hierarchical  analysis  represent  the  priori- 
ties placed  on  each  element  relative  to  other  elements  at  the  same  level,  as 
collectively  determined  by  the  individuals  participating  in  the  process.  The 
numbers  should,  then,  reflect  where  the  group  perceives  the  problems  and 
opportunities  to  lie.  The  use  of  the  pairwise  comparisons  to  establish 
importance  factors,  however,  limits  the  use  of  the  technique  to  elements  that 
are  not  strongly  interrelated.  This  limitation,  nonetheless,  is  not  all  that 
relevant,  because  the  value  of  hierarchical  analysis  is  as  much  in  the  process 
involved  in  establishing  the  importance  factors,  as  it  is  in  the  numbers 
generated.  Discussion  of  priorities  serve  as  a vehicle  for  new  insights, 
which  would  not  be  possible  with  formal  reporting  systems  alone. 
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The  priorities  generated  by  hierarchical  analysis  can,  however, 
serve  as  a frame  of  reference  for  other,  more  qu.i litati ve  policy-making 
activities.  New  policies,  plans,  and  resource  all.)'.'  tions  w ^uld  reflect  the 
priorities  established.  The  priorities  could  a.LSu  e used  to  identify  those 
aspects  of  logistics  where  management  indicators  need  to  bo  monitored.  If 
gaps  in  currently  reported  information  are  apparent,  new  indicators  should  be 
developed.  The  point  is  that  hierarchical  analysi.s  is  a flexible  tool  that 
can  be  used  in  many  ways  and  for  many  purposes.  It  does  not  make  decisions  or 
formulate  policy  but  is  a means  of  facilitating  communication,  stimulating 
discussion,  and  generating  insights. 

APPLICATION  OF  HIERARCHICAL  ANALYSIS 

In  this  section,  we  used  the  Air  Force  logistics  hierarchy  of  Figure  21 
to  show  how  importanc  ictors  are  established  and  priorities  calculated.  We 
established  the  i.mportance  factors  in  this  example;  they  are  not  meant  to 
reflect  any  recommendations  for  policy  change.  Our  numbers  are  illustrative 
only. 

After  a hierarchy  has  been  agreed  upon,  the  first  step  is  to  establish 
importance  factors  on  the  global  logistics  objectives.  In  our  example,  we 
chose  to  place  overriding  importance  on  ' oacetime  Materiel  Readiness  as 
opposed  to  Sustainability,  realizing  that  the  two  are  not  independent.  When 
put  in  matrix  form,  the  importance  factors  appear  as  in  Table  4.  The  first 
matrix  in  Table  4 is  interpreted  as  follows:  with  respect  to  the  Logistics 
Support  of  National  Defense,  Peacetime  Materiel  Readiness  (PMR)  is  given 
absolute  (9  on  the  importance  scale  of  Table  3)  importance  over  Sustain- 
ability (SUS).  The  diagonal  of  these  matrices  consists  of  elements 
whose  values  are  always  1,  since  anything  compared  to  itself  wil'  be  of  equal 
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TABLE  4.  ESTABLISHING  RELATIVE  IMPORTANCE  VALUES 


Logistics  Support 
of  National  Defease 

PMR 

PMR 

1 

SUS 

1/9 

Eigenvalue 

= A = 

2 

Peacetime 

Materiel 

Readiness 

BM 

DM 

BS 

BM 

1 

5 

3 

DM 

1/5 

1 

1/5 

BS 

1/3 

5 

1 

CS 

1/5 

4 

1/5 

TR 

1/7 

3 

1/7 

IB 

1/7 

1 

1/7 

Eigenvalue 

= A = 

6.51 

Sustain- 

ability 

BM 

DM 

BS 

BM 

1 

3 

1 

DM 

1/3 

1 

1/3 

BS 

1 

3 

1 

CS 

1/3 

1 

1 

TR 

1/4 

1/3 

1/2 

IB 

1/2 

4 

3 

Eigenvalue 

= A = 

6.43 

SUS  Eigenvector 
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TABLE  '4.  ESTABLISHING  RFLATIVE  IMPORTANCE  VALUES 

(Cont . ) 


Base 

Maint. 

NORM 

SKILLS 

UTIL 

Depot 

Maint. 

MODS 

BLOG 

UTIL 

NORM 

1 

1/3 

7 

/.30\ 

MODS 

1 

1/4 

4 

/66 

SKILLS 

3 

1 

' 1 

.63 

BLOG 

4 

1 

5 

[ .24 

UTIL 

1/7 

1/7 

1 

(.06/ 

UTIL 

1/4 

1/5 

1 

\.09 

A = 3.14 


A = 3,15 


Base 

Supply 

FILL  WRM 

NORS 

Central 

Supply 

FILL 

PIPE 

INV 

FILL 

1 3 

1/5 

FILL 

1 

3 

1/3 

WRM 

1/3  1 

1/7 

(.08 

PIPE 

1/3 

1 

1/4 
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importance.  Also,  the  matrices  arc  always  reciprocal.  That  means  that  SUS 
will  be  given  an  importance  factor  of  1/9  (the  reciprocal  of  9)  over  PMR. 

The  A shown  below  each  matrix  is  called  an  eigenvalue  of  the  matrix 
and  is  used  to  calculate  the  eigenvector  (or  priority  vector),  which  apoears 
to  the  right  of  each  matrix.  The  calculation  of  eigenv.alues  and  eigenvectors 
for  large  matrices  can  quickly  become  too  complicated  to  do  by  hand,  but 
computer  programs  are  readily  available  for  this  purpose.  The  eigenvector 
represents  the  relative  priorities  of  the  elements  compared  in  the  matrix. 
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For  comparative  purposes » the  eigeavecturs  are  always  normalized  so  that  their 
elements  sum  to  one.  So,  at  the  level  of  global  objectives  in  our  example, 
PMR  is  given  nine-tenths  of  the  available  priority  and  SUS,  one-tenth. 

At  the  next  level  of  the  hierarchy,  logistics  activities,  two  matrices 
are  needed:  one  for  pairwise  comparisons  with  respect  to  Peacetime  Materiel 
Readiness  and  the  other  with  respect  to  Sustainability.  Notice  that  the 
importance  factors  are  different  depending  on  which  global  objective  they  are 
being  compared  to.  For  example.  Base  Maintenance  (BM)  is  given  an  importance 
factor  of  3 over  Base  Supply  (BS)  with  respect  to  Peacetime  Materiel  Readi- 
ness; however,  tney  are  judged  of  equal  importance  with  respect  to  Sustain- 
ability. Likewise,  the  priority  vectors  for  each  matrix  will  be  different. 
With  respect  to  Peacetime  Materiel  Readiness,  Base  Maintenance  (BM)  is  given 
top  priority  (.44),  with  Base  Supply  (BS)  second  (.30).  With  reLoect  to 
Sustainability,  Base  Maintenance  (BM)  and  the  Industrial  Base  (IB)  are  given 
equal  priority  (.29). 

At  the  final  level  of  our  hierarchy  are  the  policy  objectives  associated 
with  each  logistics  activity  (Figure  21).  For  simplicity,  we  considered  only 
two  or  three  policy  objectives  for  each  activity.  As  mentioned  previously, 
the  detail  at  the  policy  objectives  level  of  the  hierarchy  is  perhaps  greater 
than  is  appropriate  for  the  OSD  management  role.  The  topics  of  interest  at 
this  level  include  logistics  support  concepts  and  corresponding  aspects  of 
logistics  structure,  for  example,  centralization/ decentralization  and  labor- 
intensive/capital-intensive  tradeoffs.  Therefore,  institutional  management's 
participation  at  this  level  is  appropriate.  To  be  sure,  the  major  concern  at 
the  policy  objectives  level  is  with  implementation,  which  falls  more  under  the 
purview  of  operational  management.  Nevertheless,  including  policy  objectives 
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in  the  hierarchy  gives  it  the  concreteness  it  needs  to  be  meaningful  to  the 
administrators  using  it. 

The  priorities  for  policy  objectives  might  best  be  passed  on  to  opera- 
tional management  as  institutional  management's  perceptions  of  where  the 
problems  are.  Operational  management  would  then  he  able  to  correct  any  mis- 
understandings that  may  exist  at  the  institutional  level.  Another  possibility 
would  be  to  use  input  from  operational  managers  themselves  to  assist  in 
establishing  importance  factors. 

The  final  step  in  the  procedure  is  the  calculation  of  composite  priority 
vectors  from  the  individual  priority  vectors.  These  calculations  involve 
simple  matrix  multiplication  and  are  shown  in  Table  5.  The  first  calculation 
multiplies  the  priority  vector  for  the  two  global  objectives  by  the  two  res- 
pective vectors  for  logistics  activities.  The  result  is  a new  priority  vector 
for  logistics  activities,  with  Base  Maintenance  (BM)  getting  the  largest 
portion  of  the  available  priority  (.425),  followed  by  Base  Supply  (BS)  (.287) 
and  Central  Supply  (CS)  (.109).  This  new  vector  is  then  multiplied  by  the 
matrix  of  policy  objectives.*  The  result  is  a composite  vector  over  all 
policy  objectives  that  preserves  priorities  at  every  level  of  the  hierarchy. 
In  our  example,  improving  maintenance  skills  received  top  priority  (.27); 
reducing  NORS  incidents  was  second  (.21);  and  reducing  the  NORM  rate  was  third 
(.13).  (See  the  appendix  for  a discussion  of  matrix  multiplication  and 
of  the  justification  for  the  composite  vector.) 

PROj^mCTS  FOR  HIERARCHICAL  ANALYSIS 

While  the  flow  and  resource  analyses  discussed  in  chapter  3 and  4 still 
need  substantial  technical  development,  hierarchical  analysis  is  fully 

5 

In  Table  5,  the  17  x 6 matrix  of  policy  objectives  is  not  shown. 
Because  there  are  many  zeros  in  that  matrix,  it  can  be  partitioned  into 
the  six  individual  vectors  shown. 


TABLE  5.  CALCULATING  PRIORITIES 
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developed  and  could  be  iniplemetited  with  miaimal  effort.  The  essential 
ingredient  for  successful  implementation  is  the  cooperation  of  administrators 
and  logistics  managers. 

Numerous  applications  of  hierarchical  analysis  have  been  successfully 
demonstrated  and  documented.  They  cover  a wide  range  of  policy  situations 
including: 

- The  design  of  a transportation  system  for  the  Sudan 

- Projections  of  higher  education  demands^ 

- Long-range  corporation  planning^ 

- An  assessment  of  world  influence^ 

- Energy  policy  analysis.® 

One  should  not,  however,  interpret  the  success  of  hierarchical  analysis 
as  an  indication  that  no  further  extensions  ate  p^^ssible.  On  the  contrary, 
its  success  has  stimulated  interest  in  extending  it  well  beyond  its  current 
capability.  Further  research  should  remove  some  of  the  limitations  mentioned 
in  this  chapter. 

In  suimnary,  hierarchical  analysis  adds  to  our  framework  the  capability 
for  analyzing  complex  policy  issues,  where  objectives  and  other  decision 
criteria  may  be  vaguely  defined,  and  where  there  may  conflicting  viewr  on 
how  to  resolve  the  problem.  The  technique  does  not  ..eplace  current  management 
practices  but  augments  them  with  a structured  exercise  aimed  at  clarifying  the 
issues  and  generating  new  insights. 

Hierarchical  analysis  does  require  a certain  amount  of  management  time. 
It  could  be  scheduled  to  coincide  with  mile'itones  in  the  PPB  process  or  other 
relevant  reoirring  activities.  No  one  administrator  should  be  expected  to 
devote  more  than  a day  or  two  a year  to  the  exercise,  but  at  least  a half  a 
day  should  be  allotted  for  each  group  session.  Some  time  could  be  saved  if 
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each  participant  were  required  to  prepare  bis  own  hierarchy  and  assign  his  own 
priorities  prior  to  a group  session. 

We  do  not  recommend  that  the  numbers  generated  by  hierarchical  analysis 
become  hard-and-fast  DoD  priorities.  The  numbers  should  be  viewed  primarily 
as  an  historical  record  of  the  exercise,  i.e.  , as  a reminder  of  the  issues 
discussed.  Some  insights  may  also  be  obtained  by  comparing  exercises  con- 
ducted at  different  times  or  by  different  groups. 

Problems  with  hierarchical  analysis  may  arise  with  respect  to  the  fol- 
lowing: (1)  highly  interrelated  elements  at  a particular  level  of  the  hier- 
archy, (21  arrival  at  a consensus  on  all  importance  factors,  and  (3)  full  and 
realistic  participation  by  all  members  of  the  group.  (Motivation  to  partici- 
pate may  be  hindered  by  the  somewhat  unrealistic  setting  of  the  exercise;  top 
management  interest  and  enthusiasm  can  help  the  problem.)  Still,  hierarchical 
analysis  represents  the  state  of  the  art  in  structured  group  decision-making 
processes  aimed  at  facilitating  effective  communications. 
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6.  A FRAMEWORK  FOR  POLICY-LEVEL 
LOGISTICS  MANAGEMENT 


SUMMARY  OF  PREVIOUS  CHAPTERS 

The  purpose  of  this  chapter  is  to  briag  together  the  managefflent  system 
concepts  and  selected  managenent  tools  discussed  in  the  preceding  chapters, 
and  to  show  how  they  fit  into  our  proposed  framework  for  policy-level  logis- 
tics management. 

In  Chapter  2 we  identified  the  basic  activities  of  the  DoD  management 
process,  distinguishing  between  top-level  (institutional)  and  operational- 
level  (technical)  management  responsibilities.  Next,  we  illustrated  the 
evolution  of  management  tools  in  the  context  of  our  representation  of  a 
management  system.  Finally,  we  examined  available  management  tools  and 
selected  three  as  most  appropriate  for  our  purposes;  flow,  resource,  and 
hierarchical  analysis.  Chapters  3 through  5 examined  the  application  of  these 
tools  in  a military  logistics  environment.  In  this  chapter,  we  present  an 
analytical  framework  that  outlines  a systematic  procedure  for  relating  aggre- 
gate system  input  (resources  and  policies)  to  system  output  (defense  capa- 
bility and  performance). 

THE  DEVELOPMENT  OF  APPROPRIATE  FEEDBACK 

The  key  to  this  framework  is  a thorough  understanding  of  the  use  of 
feedback  in  the  management  cycle.  (See  Figure  22.)  With  judicious  use  of 
information  from  the  operational  logistics  system,  the  appropriate  management 
tools  can  assist  in  all  major  management  functions.  Feedback  meeting  the 
requirements  for  aggregate  information  and  a systemwide  perspective  will  help 
managers  to; 

Improve  and  expand  their  capability  to  filter  information  flows 
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FIGURE  22 

OVERVIE'^  OF  LMi  APPROACH 


- Compreheod  what  the  operational  system  is  doing 

- Become  more  effective  and  efficient  in  the  decision-making 
process . 

We  will  return  to  and  enlarge  upon  Figure  22  throughout  this  section. 
Components  of  a Management  Information  Structure 

Our  management  information  structure  has  two  purposes;  (1)  to 
provide  specific  information  that  relates  system  input  and  output  to  goals  and 
objectives--on  a routine  basis;  and  (2)  to  respond  to  nnnroutine  queries. 
Thus,  the  structure  needs  two  components:  a formal  data  base  and  institu- 
tional knowledge. 
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The  Comal  data  base  is  a processing  system  which: 

- Receives,  manipulates,  and  stores  data  from  the  operational 
system 

- Produces  output  information  on  the  values  of  state,  resource,  and 
policy  variables  in  a form  acceptable  to  top  management. 

The  functions  of  data  storage  and  process  control  are  vital  for  two  reasons. 
First,  an  adequate  data  base  enhances  the  statistical  reliability  of  the  out- 
put and,  hence,  the  validity  of  subsequent  analysis  and  conclusions.  Second, 
an  historical  data  base  is  necessary  to  perform  trend  analysis  for  such 
purposes  as  tracking  indicators  selected  for  monitoring. 

The  other  component,  institutional  knowledge,  should  be  thought  of 
as  an  unstructured  repository  of  infomation.  It  is  the  sum  total  of  the 
technical  background  and  experience  possessed  by  managers  at  all  levels  of  the 
operational  system.  It  can  answer  many  different  t^'pes  of  questions  pertain- 
ing to  the  evaluation  of  data  base  output,  questions  that  cannot  be  answered 
by  quantitative  analysis.  In  many  respects,  institutional  knowledge 
transcends  the  purely  quantitative  data  base,  enriches  its  description,  and 
frequently  alters  its  implications. 

Unfortunately,  institutional  knowledge  is  neither  catalogued  nor 
indexed.  Not  all  top-level  OSD  managers  are  equally  skilled  at  applying  it. 
In  addition,  the  managers  themselves  have  different  degrees  of  operational 
experience,  and  thus  different  opinions  about  the  utility  of  institutional 
knowledge.  These  differences  suggest  a need  for  developing  some  measure  of 
the  value  of  institutional  knowledge.  Adequately  calibrated,  this  knowledge 
can  provide  Judgmental  estimates  of  policy  and  resource  parameters  affecting 
top  management  decisions.  As  pointed  out  in  chapter  2,  it  is  possibly  the 
best  source  of  information  about  what  will  work  and  what  will  not. 


Management  Indicators 


Management  indicators  are  the  next  step  in  the  development  of  ap- 
propriate feedback.  The  purpose  of  indicators  is  to  improve  the  visibility  of 
the  logistics  system  with  respect  to  policies  and  objectives.  In  most  organi- 
zations, objectives  are  hierarchical,  i.e.,  attainment  of  an  objective  at  a 
high  level  results  from  attainment  of  numerous  objectives  at  a lower  level. 
Hence,  measures  of  attainment  are  likewise  hierarchical. 

This  relationship  between  objectives  and  measures  is  two-edged, 
however.  The  process  of  selecting  measures  may  suggest  to  managers  that  the 
objectives  need  to  be  re^ised.  Hence,  establishing  objectives  and  selecting 
measures  are  interactive  processes,  which  means  that  the  measures  should  be 
designed  with  as  much  care  as  is  expended  in  establishing  the  objectives. 

Based  on  our  structure  of  the  management  process,  indicators  can  be 
categorized  in  terms  of  the  following  types: 

- Resource  utilization 

- Policy  compliance 

- System  performance. 

A resource  utilization  indicator  might  provide  information  on 
whether  resources  are  being  used  where  they  were  allocated.  A policy  com- 
pliance indicator  might  be  one  designed  to  determine  if  reliability  and 
maintainability  goals  are  being  achieved.  System  performance  indicators  may 
be  designed  to  provide  measures  of  materiel  flows  and  of  proxies  for  flow 
capacities  (e.g.  repair  backlogs,  changes  in  the  NORM  rate,  etc.)  Performance 
indicators  ace  related  to  the  other  categories  because  resources  and  policies 
are  inputs  to  system  performance. 


la  Phase  2 of  this  study,  we  collected,  analyzed,  and  displayed 
indicators,  but  we  did  not  organize  them  into  the  above  groups.  We  have  now 
attempted  to  develop  a framework  that  uses  these  indicators  and  that  incor- 
porates tools  to  be  used  at  the  top  management  level. 

The  major  problem  is  what  criteria,  if  any,  can  be  used  for  select- 
ing indicators.  We  believe  that  absolute  criteria  cannot  be  determined;  the 
selection  process  must  be  iterative,  evolutionary,  and  dynamic.  A compre- 
hensive set  of  indicators  can  be  developed  only  through  the  interactions  of 
the  operational  system,  the  information  structure,  and  top  management.  These 
groups  must  work  in  concert  to  test  and  revise  indicators,  refine  reporting 
rules  and  regulations,  and  add  or  delete  indicators  dictated  by  managerial 
requirements . 

Having  addressed  the  management  information  structure,  the  manage- 
ment functions  which  it  supports,  and  the  management  tools  to  be  applied,  we 
are  now  prepared  to  specify  their  roles  in  an  analytical  framework. 

AN  ANALYTICAL  FRAMEWORK  FOR  POLICY-LEVEL  MANAGEMENT 

We  can  describe  this  framework  most  readily  in  terms  of  information 
flows,  such  as  those  portrayed  in  Figure  23,  which  converts  the  functional 
diagram  of  Figure  22  into  an  information  flow  chart.  In  the  following 
section,  we  explain  how  the  management  information  components  and  management 
tools  should  interact  to  provide  a coherent  management  system. 

The  operational  logistics  system  provides  feedback  of  data  to  the  manage- 
ment information  structure,  constantly  adding  to  the  Logistics  data  base  and 
expanding  the  scope  of  institutional  knowledge.  The  logistics  data  base 
provides  top  management  with  either  management  indicators  or  with  data  that 
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can  be  processed  by  tread  or  structural  analysis  into  indicators.  The  body  of 
information  represented  by  management  indicators  flows  three  ways: 

- Indicators  pose  specific  questions  on  the  operational  system's, 
performance,  questions  that  can  best  be  answered  through  insti- 
tutional knowledge. 

- Indicators  provide  trend  and  structural  data,  which  are  the  basis 
for  flow  and  resource  analysis. 

- Indicators  provide  information  on  resource  utilization,  system 
performance,  and  policy  compliance  needed  for  hierarchical 
analysis . 

The  information  provided  by  our  framework  exposes  and  clarifies  the 
relationships  between  system  variables  treated  in  flow  and  resource  analysis, 
and  assists  in  the  reevaluation  of  the  nriorities  derived  from  hierarchical 
analysis.  The  relationships  reveal  constraints  on  the  policy,  planning,  and 
resource  allocation  alternatives  available  to  top  management;  the  priorities 
help  to  define  logistics  goals  and  objectives.  Together,  the  relationships 
and  priorities  contribute  to  the  evaluation  of  policy  alternatives  by  pro- 
viding a structured  view  of  the  system  and  of  the  direction  top  management 
Judges  it  best  proceed. 

APPLICATION  TO  OSD 

We  believe  the  approach  presented  in  this  report  provides  a fresh  per- 
spective on  how  policy  management  at  the  OSD  level  can  function  in  relation  to 
the  Services.  Further,  the  technical  proposals  made  can  make  many  beneficial 
contributions  to  such  policy  management. 

Top-Level  Visibility 

OSD  does  not  lack  information,  but  the  information  provided  is  in 
piecemeal  fashion  and  has  been  produced  primarily  for  operational  management 
purposes.  The  purpose  of  our  framework  is  to  provide  policy- level  management 
with  directly  relevant  information.  This  means  that  the  information  must  have 
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a system./idc  perspective,  and  be  processed  in  an  appropriately  aggregate  form. 
The  proposed  framework  has  been  designed  to  enhance  the  visibility  of  infor- 
mation at  the  OSD  level  by; 

- Providing  a systematic,  methodical  structure  for  use  of  manage- 
ment tools; 

- Linking  resources  and  policies  to  material  flows  and  capacities; 

- Addressing  management  objectives  through  priority  assignments; 

- Operating  on  aggregate  information; 

- Using  multiple  forms  of  feedback;  and 

- Assisting  management  in  evaluating  alternatives. 

Issue  Identification  and  Analysis 

The  framework  for  policy-level  logistics  management  presented  in 
this  report  is  directly  applicable  to  OSD  needs.  The  techniques  described  here 
can  expose  relationships  between  system  performance,  resources,  and  policies 
sufficiently  aggregate  for  OSD  p.ti.'poses.  With  these  tools,  OSD  can  make 
tradeoffs  on  system  variables  that  take  into  account  its  assignment  of  priori- 
ties and  asnessment  of  objectives.  Such  a capability  will  enhance  the  quality 
of  its  decision-making,  and  permit  the  exercise  of  a level  of  control  appro- 
priate to  its  role. 

When  fully  developed,  this  framework  should  be  applicable  to  the 
identification  and  analysis  of  logistics  issues. 

For  example,  management  might  wish  to  know: 

Is  the  increasing  NORM  rate  a reflection  of  manpower 

limitations,  or  is  it  a reflection  of  a shifting  aircraft 

mix,  or  is  it  even  indicative  of  a reduced  logistics 

capability? 
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Use  of  these  management  tools  should  also  assist  ASD  (MRA&L)  parti- 
cipation in  the  PPBS.  One  question  that  could  be  addressed  is: 

What  tradeoffs  between  base  and  depot  maintenance 
resources  are  possible,  given  some  specified  readiness  and 
sustainability  objectives? 

Finally,  the  tools  should,  if  properly  implemented,  have  significant 

application  to  long-range  or  strategic  planning.  Here  an  example  of  an 

appropriate  question  might  be: 

What  logistics  support  concepts  are  compatible  with  long- 
term defense  goals  and  projected  defease  technologies? 

Structured  Interaction 

The  one  word  that  best  describes  the  contribution  of  this  framework 
is  "structure".  With  a meaningful  structure,  interaction  between  insti- 
tutional and  operational  management  should  be  Improved.  The  quantity  of 
extraneous  data  flowing  to  top  management  should  be  reduced,  and  the  quality 
of  that  information  still  provided  to  OSD  should  be  improved.  The  management 
tools  in  the  framework  cannot  and  will  not  replace  policy-making  as  we  know 
it.  That  process  is  intrinsically  one  of  bargain  and  compromise  and  is 
strongly  influenced  by  political  considerations.  The  framework  provides  OSD 
management  with  a method  for  processing  relevant  Information  and  thereby 
enriches  the  policy-making  process. 
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7 . RECOMMENDATIONS 


STATUS  OF  THE  FRAMEWORK 

This  report  provides  a framework  for  policy-level  logistics  management, 
focusing  on  broad  policy  guidance,  resource  allocation,  and  strategic  plan- 
ning. The  framework  contains  several  unique  elements: 

- It  distinguishes  policy  management  from  operational  management, 
focusing  on  the  needs  of  the  policy  level . 

- It  proposes  an  explicit  and  tested  method  for  structuring  and  eval- 
uating goals,  objectives,  and  policies. 

- It  contains  quantitative  tools  for  policy  analysis,  resource  alloca- 
tion, and  monitoring  the  operational  system. 

- It  incorporates  management  Indicators  within  policy  management. 

- It  provides  for  the  use  of  institutional  knowledge  as  a major  part  of 
the  information  exchange  between  the  policy  and  operational  manage- 
ment. 

The  benefits  and  advantages  to  be  gained  from  these  elements  justify 
further  research  on  the  framework,  the  techniques  contained  in  it,  and  its 
application.  The  following  describes  the  further  work  that  should  be 
supported. 

REQUIRED  RESEARCH 

The  major  piece  of  required  research  is  quantification  of  the  impact 
graphs.  Chapter  A discussed  some  possible  approaches  to  this  problem.  We 
have  pointed  out  the  difficulties  in  measuring  capacities  of  logistics 
activities,  which  are  the  state  variables  in  flow  and  resource  analysis.  The 
selection  of  appropriate  proxies  for  the  capacities  could  be  a satisfactory 
way  to  quantify  them  for  the  impact  graphs.  Both  historical  data  and  institu- 
tional knowledge  could  contribute  to  this  effort. 
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Existing  detailed  models  could  also  be  used  for  quantification  of  the 
impact  graphs.  The  METRIC-type  models  developed  within  the  Air  Force  can  be 
used  to  generate  tradeoff  curves  that  relate  an  appropriate  measure  of  supply 
system  performance  with  exchangeable  items  to  dollar  investment  in  such  items. 
The  measures  of  effectiveness  used  with  these  models  are  typically  expected 
number  of  backorders  and  in  the  case  of  LHI  Availability  (METRIC),  supply 
availability  rates.  Tradeoffs  are  calculated  over  a wide  range  of  aggregate 
investment  dollars,  so  that  depending  on  the  investment  interval  being 
analyzed,  the  relevant  slope  of  the  tradeoff  curve  can  be  calculated  to 
provide  the  coefficient  for  the  impact  graph. 

Maintenance-operations  simulations  could  also  be  used  to  help  develop  the 
impact  graphs.  The  Air  Farce's  LCOM  (.Logistics  Composite  Model)  is  a detailed 
simulation  of  aircraft  and  maintenance  operations  that  emphasizes  the  manpower 
resource  impact  on  aircraft  squadron  sortie  capacity.  Manpower  is  treated  in 
terms  of  both  skill  category  and  skill  level.  The  intent  would  be  to  estab- 
lish how  the  results  of  such  simulations  should  be  used  to  determine  the 
structure  and  parameters  of  the  impact  graph. 

Our  survey  of  existing  detailed  models  used  by  the  Services  indicates 
that  they  can  be  very  useful  in  the  research  phase.  These  models  are  re- 
ceiving greater  acceptance  within  DoD,  and  their  quality  is  constantly  being 
improved.  The  linking  of  these  detailed  models  to  the  aggregate  impact  graphs 
will  facilitate  consistency  between  the  Service  use  of  the  models  and  OSD  use 
of  the  techniques  proposed  in  this  report. 

Another  topic  discussed  in  chapter  4 as  important  for  successful  devel- 
opment of  the  impact  graphs  is  the  of  subjective  judgment  to  obtain 
estimates  of  the  impact  of  changing  budget  and  program  situations  on  logistics 
capability.  Here,  we  are  referring  to  the  use  of  institutional  knowledge  to 
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obtain  subjective  information.  Research  is  needed  to  determine  effective  ways 
of  eliciting  responses  from  individuals  and  groups  concerning  relationships 
between  state  and  control  variables.  We  strongly  believe  that  sufficient  in- 
formation about  these  relationships  exists  within  DoD.  Questionnaires  are  one 
way  of  getting  at  this  information,  but  other  methods,  including  the  use  of 
interactive  computer  techniques,  may  be  more  effective.  Another  possibility 
is  to  use  a modified  form  cf  hierarchical  analysis  to  quantify  the  values  on 
an  impact  graph,  which  would  quantify  subjective  judgement  in  an  explicit  and 
consistent  manner. 

OTHER  iMPROVEhFNTS 

A few  other  topics  deserve  attention  because  they  will  improve  the  quality 
of  the  tools  used  within  our  framework.  One  such  subject  is  the  introduction 
of  time  lags  into  the  flow  and  impact  graphs.  These  time  lags  need  to  be 
incorporated  without  unduly  complicating  the  evaluation  process.  Recognizing 
that  time  lags  can  be  used  to  represent  the  policy  as  well  as  physical 
constraints,  we  would  prefer  to  depict  time  lags  as  single  valued  variables 
rather  than  distributed  variables  since  the  former  are  simpler  to  handle. 
Research  in  this  area  would  involve  using  institutional  knowledge  to  obtain 
estimates  of  time  lags,  as  well  as  sensitivity  testing  with  the  flow  and 
impact  graphs  to  assess  the  effects  of  time  lags  on  the  types  of  guidance 
compatible  with  policy-level  management. 

Risk  analysis  is  another  possible  area  for  Improvement.  Recent  work  on 
the  subject  was  described  in  Chapter  4.  Our  purpose  would  be  to  adapt  the 
available  knowledge  to  our  needs,  and  thereby  expand  tne  quantitative  capa- 
bility of  our  tools. 
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VALIDATION 
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Given  continued  management  sponsorship  of  the  development  of  this 
framework,  we  should  give  early  attention  to  what  is  required  to  validate  our 
approach.  By  validation  we  mean  an  objective,  and  preferably  quantitative, 
assessment  of  the  output  provided  by  the  management  tools  proposed  in  this 
report.  We  suggest  applying  them  to  realistic  problems,  computing  the 
outputs,  and  comparing  them  against  results  obtained  by  other  available 
methods.  Bases  of  comparison  would  include  aggreement  of  the  numerical 
results,  the  relative  costs  of  producing  the  findings,  and  the  timeliness  with 
which  they  could  be  provided. 

The  DoD  problem  used  in  chapter  5 might  serve  as  a means  of  validation. 

It  involves  a policy*level  problem,  and  our  work  to  date  has  developed  a 
structure  and  context  for  analyzing  it.  Also,  it  is  the  type  of  logistics 
problem  that  has  to  be  addressed  each  year,  since  it  focuses  on  issues  like 
readiness  and  sustainability.  OoD  has  made  decisions  on  resource  allocation 
in  this  area  for  FY  1979,  and  their  results  either  for  that  year  or  the  fol> 
lowing  year  could  serve  as  validating  numbers  with  appropriate  interpretation. 

Thus,  our  effort  would  involve  quantification  of  the  flow  and  impact 
graphs,  and  their  use  in  conjunction  with  the  hierarchical  analysis  would 
provide  the  estimates  needed  for  validation.  Because  we  would  have  to  rely  on  | 

institutional  knowledge  for  certain  relationships  and  estimates,  we  would 
require  some  access  to  informed  DoD  people,  as  well  as  to  some  official 
documents.  Such  a validation  exercise  could  be  completed  within  six  months, 
following  the  necessary  development  of  a data  collection  instrument  for 
resource  analysis. 


IMPI*EMENTATION 


The  validation  test  would  go  far  toward  achieving  implementation  of  the 
proposed  framework.  Initial  contacts  at  the  policy  and  operational  levels 
during  the  validation  phase  could  be  augmented,  as  necessary,  tc  prepare  for 
subsequent  implementation. 

When  implemented,  the  system  should  provide  for  computer  operation  of  the 
flow  and  impact  graphs.  Much  of  the  computer  programming  can  be  done  during 
the  validation  phase.  In  its  final  form,  the  system  should  include  inter- 
active computer  processing  of  the  flow  and  impact  graphs,  designed  for  use  by 
management  personnel. 

The  process  of  hierarchical  analysis  should  also  be  computerized  during 
the  validation  phase.  Again,  provision  for  interactive  computation  would  be 
valuable,  so  that  users  could  receive  immediate  feedback  on  the  weights 
assigned  to  the  hierarchical  elements. 

Thus,  the  validation  and  implementation  phases  would  probably  overlap  to 
a considerable  extent,  with  the  implementation  phase  serving  largely  to  add 
greater  computer  capability  to  the  operation  of  the  tools.  Implementation 
time,  therefore,  should  not  be  much  longer  than  the  six  months  estimated  for 
the  validation  phase. 

ADDITIONAL  APPLICATIONS 

Service  Logistics  Systems 

Our  development  effort  used  the  Air  Force  as  a testing  ground  for 
our  proposed  policy-level  management  framework.  We  believe  that  the  system 
could  be  used  by  the  Air  Force  for  its  orn  policy  management,  and  by  OSD  to 
encourage  similar  systems  in  the  other  Services.  As  with  the  Air  Force,  the 
Army  and  Navy  systems  could  be  operated  independently  as  they  are  implemented, 
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so  there  would  be  uo  need  to  wait  for  one  system  before  the  others  could  be 
put  into  operation. 


The  role  of  OSD  in  the  initial  stages  should  be  to  encourage  and 
monitor  the  Service  efforts.  This  experience  should  help  OSD  to  define  its 
own  needs  more  clearly.  Very  likely,  OSD's  needs  will  ultimately  generate 
special  requirements  for  information  and  policy  that  will  transcend  those  of 
the  individual  Services.  We  believe  that  much  of  this  information  could  be 
drawn  from  existing  institutional  knowledge  within  the  Services,  so  that  the 
formal  information  needs  would  not  be  expanded. 

Manpower 

The  concept  of  policy  management  developed  in  this  report  for 
logistics  should  apply  equally  well  to  manpower.  In  fact,  objectives  and 
policies  established  in  either  management  area,  without  due  regard  for  their 
impact  in  the  other,  could  have  adverse  implications.  From  an  overall  budget 
standpoint,  the  ties  between  logistics  and  manpower  are  very  strong,  since 
about  40-50  percent  of  OoD  manpower  is  assigned  to  logistics  specialties,  and 
over  65  percent  of  logistics  costs  can  be  attributed  to  perscnuel. 

Manpower  is  shown  explicitly  as  elements  in  the  impact  graphs  in 
chapter  4,  in  terms  of  appropriate  budget  funding  categories  that  constrain 
the  flow  and  capacities  of  the  logistics  activities.  Manpower  is  also 
implicitly  reflected  in  most  logistics  activities  and  in  the  state  variables 
of  logistics  performance  contained  in  the  flow  graphs.  Use  of  the  tools 
described  in  this  report  for  manpower  management  could  mean  a more  compre- 
hensive representation  of  manpower  iojpacts  by  explicitly  identifying  resource 
variables  according  to  major  skills,  specialties,  and  grades.  In  turn, 
demands  for  manpower  skills  could  be  translated  into  recruiting  and  training 
workloads  for  manpower  management. 
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The  meation  of  manpower  is  to  emphasize  the  generality  of  the  tools 
we  have  developed  and  the  significance  of  the  interactions  between  manpower 
and  logistics  management;  and  to  indicate  that  more  detail  on  manpower  can  be 
included  if  desired.  A complete  analysis  for  manpower  and  personnel  would  be 
comparable  to  that  required  for  logistics.  Such  an  effort  could  be  done 
independently  of  the  logistics  work,  but  at  the  same  time  take  advantage  of 
the  experience  gained  in  the  prior  research. 

We  believe  this  framework  for  policy-level  logistics  management  has 
a potential  for  significant  contribution  to  DoD.  Much  of  the  conceptual  and 
empirical  effort  has  been  done.  Relatively  little  work  remains  to  be  done  to 
make  this  framework  useable. 
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APPENDIX 


TECHNICAL  ASPECTS  OF 
HIERARCHICAL  ANALYSIS 


INTRODUCTION 

One  of  the  most  difficult,  yet  important,  problems  for  decision-makers  is 
how  to  rank  or  prioritize  multiple  activities,  elements,  criteria,  etc., 
logically  and  tationally.  Such  ranking  is  often  vital  to  allocate  resources 
among  activities  or  to  implement  activities  by  priority.  Without  such  a 
ranking,  decisions  may  be  made  :.nd  actions  taken  that  produce  no  progress 
toward  stated  objectives  or,  what  is  worse,  results  contrary  to  those  objec* 
tives.  Yet,  too  often  the  method  used  is  an  intuitive,  qualitative  technique, 
which  provides  no  sound  foundation  for  the  process  other  tl  .n  the  intelligence 
and  experience  of  the  decision-maker. 

Dr.  Thomas  L.  Saaty  ha.s  developed  a quantitative  algorithmic  method  that 
permits  the  decision-maker  not  only  to  structure  the  decision  environment,  but 
also  to  solve  the  ranking  or  prioritization  problem.  This  appendix  is  .m 
abbreviated  discussion  of  that  method  and  its  supporting  theory,  as  originally 
presented  in  'A  Scaling  Method  for  Priorities  in  Hierarchical  Structures."^ 
Except  where  otherwise  noted,  ail  of  the  procedures  and  theory  herein  are 
derived  from  this  s 'rce. 

In  the  following  section,  we  explore  eigenvalue  theory  and  show  how  it 
can  be  applied  to  quantitative  judgmental  assigranents , using  paired  compari- 
sons to  produce  a vector  of  uumbers  which  express  the  relative  preferences 
for,  or  importa  ice  of,  a set  of  related  objects.  Problems  of  consistency  in 
preference  matrices  are  al.so  discussed. 
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The  final  section  discusses  the  development  of  hieracchie'!  and  their 

use  in  conjunction  with  the  eigenvalue  analysis  presented  in  the  previous 

section.  It  concludes  with  a mathematical  justification  for  the  use  of 

matrix  and  eigenvalue  theory  in  that  development. 

Hierarchical  analysis  is  not  merely  an  intellectual  exercise.  Saaty 

has  applied  this  method  to  the  development  of  a master  transportation  plan 

2 

for  the  Sudan  which  has  received  widespread  critical  acclaim. 

QUANTIFICATiOK  OF  JUDGMENTS 
Eigenvalue  Analysis 

The  eigenvalue  theory  described  below  has  a number  of  applications 
in  many  areas  of  mathematics.  We  start  by  stating  a problem:  given  a square 
n X u matrix  A,  determine  the  values  of  the  scalar,  and  the  non-zero 

vectors,  w,  which  satisfy  the  equation; 

Aw  = \w.  (1) 

This  matrix  equation  may  also  be  written  as: 

^ ^ “in  ”n  = 

“2l''»  “22"2  ^ * “2n  % = ^'^2 


a ,w,  + a .,w„  + ...  + a w = \w 
nl  1 n2  2 nn  n n 

Subtracting  the  right  side  of  (2)  from  both  sides,  we  obtain: 


11 

\)Wi  + a^2  “2 

+ . . . 

+ a,  w 

In  n 

It 

O 

CM 

^^22  ■ 

A)w2  + . 

. . + a-  w 

2n  n 

o 

II 

a ,w, 
nl  1 


^ “n2''2  ^ 


+ (a  -A.)w  = 0 

nn  n 
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(3) 


This  caa  be  written  in  matrix  notation  as: 


(A  - \I^)w  =0,  (4) 

where  is  the  n x n identity  matrix.  Obviously,  if  w is  a zero  vector, 
(4)  is  satisfied.  If  w is  non-zero,  however,  solutions  to  (4)  exist  only 
if  the  determinant  of  (A  - is  zero,  written  as: 

|a  - AI^  1=  0,  (5) 

Values  of  A that  satisfy  tuose  solutions  are  called  the  eigenvalues , char- 
acteristic values,  proper  values . or  latent  roots  of  (5).  The  corresponding 
solutions  w 0 of  (4)  are  called  eigenvectors  or  characteristic  vectors 
of  A.  A matrix  of  order  n will  have  n eigenvalues,  not  necessarily  real  or 
distinct. 


To  illustrate,  we  will  find  the  eigenvalues  and  eigenvectors  of 
the  matrix: 

1 3' 


A = 


3 1 


Solution: 


A - AI  = r /I  O' 


.3  1. 


.0  1. 


^1-A  3 ' 

. 3 1-A, 


0 = A-AI  = (1  - A)^  - 9 = A^  - 2A  - 8 = (A  - 4)  (A  + 2) 

The  eigenvalues  of  A,  then,  are  4 and  -2. 

With  these  values  of  A in  the  format  of  (1),  we  obtain 

3\ 


c 


w w 4w 


3 ly 


and 


I 3\ 
.3  1/ 


w = -2w 


(6) 

(7) 


(8) 


(9) 
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Rearranging  these  equations  into  the  fonaat  of  (3),  we  obtain: 


and 


(:  - 4)w^  + 3 w^  = 0 

3Wj  + (1  - 4)w2  = 0 


(1  + 2)Wj  + 3 W2  = 0 
3Wj  + (1  + 2)w2  = 0 


From  (10),  = w^;  from  (11),  = -w^.  Hence,  there  is  no  unique  w for  each 

of  the  corresponding  eigenvalues  of  A,  since  any  set  of  real  or  complex 
numbers  satisfying  either  (10)  or  (11)  is  an  eigenvector  of  A,  corresponding 
to  the  eigenvalues  A = 4 and  A = -2,  respectively. 

If  we  consider  only  matrices  whose  elements  are  all  real  and  posi- 
tive, then  it  can  be  shown  that  such  a matrix  has  a real  positive  A,  which  is 
at  least  as  large  as  any  of  the  remaining  (n  - DA's.  Let  us  call  that  value 

A Also,  the  eigenvector  w associated  with  A can  be  chosen  real  and 

max  max 

with  all  positive  components. 

Further,  let  us  consider  only  reciprocal  matrices,  ones  in  which  a^^ 
= b11  i and  j.  Obviously,  a^^  = 1 for  all  i and,  equally  obviously, 

there  can  be  no  zero  entries  if  the  a^^  are  all  > 0.  Also,  we  impose  the 
constraint  that 
a 


Z w = 1, 

i=l 


which  merely  ensures  a unique  value  for  the  eigenvector  associated  with 

A . 
max 


To  determine  the  eigenvalues  of  an  n x n matrix  requires  the 
solution  of  a polynomial  equation  of  degree  n.  As  n increases,  it  becomes 
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more  and  more  inefficient  to  obtain  that  polynomial  by  a direct  expansion  of 
the  determinants  defining  it.  Numerical  techniques  are  preferable  and  are 
frequently  available  in  computer  library  routines. 

The  remainder  of  this  section  describes  Saaty's  application  of 
eigenvalue  theory  described  above  to  the  pairwise  assignment  of  quantitative 
judgments  and  his  treatment  of  the  inconsistency  problem. 

Pairwise  Comparisons 

One  of  the  basic  problems  in  the  management  process  is  the  inte** 
gration  of  human  judgments  into  decisions;  that  is,  how  can  opinions  be 
systematicclly  interjected  into,  and  accommodated  by,  the  process  so  that  the 
manager  may  formulate  alternatives  and  select  decisions?  To  limit  the  scope 
of  the  problem,  we  will  consider  only  the  quantification  of  judgments.  In 
other  words,  we  will  attempt  to  design  a procedure  by  which  a real  number  can 
be  assigned  to  represent  the  expression  of  human  judgment  or  preferences 
between  and  among  a variety  of  "objects."  Here,  "objects"  may  refer  to 
specific  entities,  alternative  choices,  policies,  activities,  etc. 

The  first  question  is:  how  many  objects  should  be  considered  at  one 
time?  Miller  showed  that  an  individual  cannot  simultaneously  compare  more 

3 

than  seven  (plus  or  minus  two)  objects  without  confusion.  Hence,  we  could 
choose  as  many  as  nine  objects  for  simultaneous  comparison.  To  make  the 
problem  as  simple  as  possible,  however,  we  choose  to  limit  our  objects  to  two, 
i.e.,  pairwise  comparisons.  With  this  simplification  we  exclude  all  but 
two  objects,  compare  them  with  respect  to  some  criterion,  and  assign  to  that 
comparison  a unique  real  number.  Hence,  with  n objects  0^,  1 = 1,  2 ...,  n, 
we  compare  0^  with  0^,  excluding  the  remaining  n-2  0^,  and  assign  a number 
to  the  comparison.  Next,  we  compare  0^  with  0^,  excluding  the  remaining  0^ 
(and,  in  fact,  attempting  to  exclude  the  results  of  our  comparison  of  0^  with 
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O2),  and  assign  a number  a^^  that  comparison,  and  so  forth,  until  we  have 
generated  a^^  through  a^^.  Kext,  we  compare  O2  with  O^,  etc.,  generating  ^22 
through  ^2^,  and  continue  until  we  have  produced  all  the  values  of  a^j  for 

j > i. 


The  next  question  is:  what  scale  of  real  numbers  should  we  use  for 
the  a^j?  Whatever  the  scale,  it  should  satisfy  four  criteria: 

- It  should  represent  people's  differences  in  feelings  when  they 
make  comparisons  and,  insofar  as  possible,  all  distinct  shades  of 
feeling  from  indifference  to  absolute  preference. 

- The  principal  gradations  of  the  scale  should  be  unit  values, 
i . e . , one . 

- The  people  making  the  comparisons  must  be  aware  of  all  scale 
gradations  at  the  same  time  without  confusion. 

- The  gradations  of  the  scale  should  be  positive,  real  numbers  (to 
permit  us  to  employ  the  eigenvalue  theory  discussed  earlier) . 

The  first  issue  to  settle  is:  what  number  should  be  used  to  measure 
"equality"  or  "indifference"  between  two  objects?  Clearly,  comparing  an 
object  with  itself  produces  equality,  so  the  issue  reduces  to  what  value  to 
assign  to  a^^,  i.e.,  the  real  number  generated  by  comparing  0^  with  itself. 
But  since  we  are  considering  only  reciprocal  matrices,  in  which  a^^  = 1 for 


all  i,  we  assign  unity  as  the  measure  of  equality  or  indifference. 

Next,  what  should  be  the  range  of  the  scale?  Miller's  findings  lead 
us  to  choose  a scale  of  7+2=9  units.  With  unity  as  our  benchmark,  the 
scale  values  will  range  from  1 to  9.  This  selection  results  in  satisfying  all 
of  the  criteria  mentioned  above.  Since  we  consider  only  reciprocal  matrices 
(fortunately,  maintaining  the  constraint  of  positive  numbers),  the  scale  for 
comparing  0^  with  0^  ^®ji^  will  range  from  1/9  to  1 . In  other  words,  when  our 
comparison  of  0^  with  Oj  results  in  a^j , our  comparison  of  0^  with  0^  auto- 
matically results  in  A-1  reproduced  from  chapter  5, 
defines  this  scale  and  explains  it  in  subjective  terras.  We  do  not  rule  out 
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TABLE  A-1.  IMPORTANCE  SCALE 


Intensity 


of  Importance 

Definition 

Explanation 

1 

Equal  importance 

Two  activities  contribute  equally 
to  the  objective. 

3 

Weak  importance  of 
one  over  another 

Experience  and  judgement  slightly 
favor  one  activity  over  another 

5 

Essential  or  strong 
importance 

Experience  and  judgment  strongly 
favor  one  activity  over  another 

7 

Demonstrated 

importance 

An  activity  is  strongly  favored 
and  its  dominance  is  demonstrated 
in  practice 

9 

Absolute  importance 

The  evidence  favoring  one  activity 
over  another  is  of  the  highest 
possible  order  of  affirmation 

2, 4, 6, 8 

Intermediate  values 
between  two  adjacent 
judgments 

When  compromise  is  needed 

Reciprocals 

If  activity  i has  one 
of  the  above  numbers 
assigned  to  it  com- 
pared to  activity  j , 
then  j has  the  recipro- 
cal value  compared  to  i 

Rationals 

Ratios  arising  from 
the  scale 

If  consistency  is  to  be  forced 
by  obtaining  n numerical 
values  to  span  the  matrix 

the  use  of  other  scales;  Saaty  has  examined  a niunber  of  them,  but  recommends 
the  one  set  forth  here. 

Two  significant  questions  have  to  be  answered: 

- What  is  the  justification  for  using  that  scale  to  evaluate 
importance  or  preference? 

> Assuming  that  scale  can  be  justified,  how  can  we  translate  the 
individual  comparisons  into  a priority-ordered  set?  We  will 


illustrate  the  answer  with  an  analogy  and  subsequently  will 
introduce  a theorem  that  provides  rigorous  justification. 

Suppose  we  wish  to  compare  the  physical  weights  w^  of  n objects  A^, 
i = l,2,...,n,  but  we  have  only  a balance  scale  so  that  we  are  unable  to 
measure  their  absolute  weights.  With  a balance  scale,  however,  we  can  compare 
with  A j ; record  the  value  of  the  ratio  w^/Wj , denoted  as  a^^;  and  display 
the  results  as  matrix  A: 


A 

A 


1 

2 


Wi  /Wj  Wj  /w^ 

Wj  /Wj  w^  /W2 


Wj  /w 
w^  /w 


n 

n 


A = 


'n  ^"1 


"n  /”2 


w /w 
n n 


(aij) 


How  can  we  determine  the  relative  physical  weights  of  all  the  A^? 
T 

Let  w = (Wj,  w^,  ...,  w^)  be  the  vector  of  the  absolute  physical  weights. 

Then,  if  we  multiply  the  matrix  A by  w,  we  obtain  Aw  = nw;  i.e.,  (w^/w^)  • w^ 

+ (w,/w-)  • w.,  + ...  + (w,/w  ) • w = n*w.  for  i = l,2,...,n.  Now  we  solve 

'■122  i n n 1 » » > 

this  equation  for  w,  i.e.: 

(A  - nl)  w = 0.  (12) 

But  this  is  precisely  the  same  format  as  (A),  which  leads  to  the  solution  of 
the  eigenvalues  of  A,  with  A = n. 

Once  we  have  solved  for  A , we  can  produce  a non-unique  solution 

max 

for  w'^.  If  we  again  impose  the  arbitrary  normalizing  constraint  that 

n 

1 w,  = 1, 
i=l 

^‘‘We  use  A because  there  is  no  assurance  that  any  of  the  remaining 
eigenvalues  are^fial  and  positive. 
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we  have  produced  a unique  value  for  w that  displays  the  relative  physical 
weights  of  all  the  a objects. 

For  example,  suppose  we  have  four  objects  whose  weights  (unknown  to 
us)  are:  = 5,  W2  = 4,  = 2,  and  * 1.  Comparing  these  objects  pairwise 
on  a balance  scale  (i.e.,  comparing  object  1 with  object  2,  object  1 with 
object  3,  etc.),  we  derive  the  following  results: 


A = 


^5/5  5/4  5/2  5/1 

4/5  4/4  4/2  4/1 
2/5  2/4  2/2  2/1 

1/5  1/4  1/2  1/1, 


(13) 


As  it  happens,  = 4.  Using  this  value  in  the  format  of  (4),  we 


produce; 


1 - 4 

1.25 

2.5 

5 

.8 

1 - 4 

2 

4 

.4 

.5 

1 - 4 

2 

.2 

.25 

.5 

1 

(14) 


Again,  since  (14)  does  not  produce  a unique  value  for  2,  we  add  the  normal- 
izing constraint  that 


4 

1 w , = 1 . 


T 

The  resulting  value  of  w is  (5/12,  4/12,  2/12,  1/12)  and  reproduces  the 
relative  physical  weights  of  the  four  objects. 

Hence,  we  have  shown  how  the  use  of  pairwise  comparisons  on  a 
numerical  scale,  coupled  with  eigenvalue  analysis,  can  generate  an  ordered  set 
of  numbers,  which  reflect  precisely  the  relative  weights  of  all  the  objects 
compared.  But  there  is  no  reason  why  we  must  restrict  our  interpretation 
of  the  ratios  to  those  of  physical  weights;  we  can  interpret  them  to 
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mean  siz<?,  Importance,  or  personal  preference.  Indeed,  Saaty  shows  that, 
regardless  of  the  interpretation,  if  there  exists  some  absolute  ordinal  scale 
by  which  objects  are  measured,  then  the  ordered  values  of  the  elements  of  w 
generated  by  the  eigenvalufi  theory  preserve  the  ordering  of  the  ordinal  scale. 
This  preservation  of  ordinal  consistency  is  of  central  importance  in  justi- 
fying the  use  of  the  preference  scale. 

Consistency 

Before  we  show  how  the  use  of  pairwise  comparisons  and  eigenvalue 
analysis  can  be  applied  to  hierarchies,  we  must  address  one  problem:  matrix 
consistency  and  the  effect  of  departures  from  consistency  upon  the  preser- 
vation of  ordinal  consistency  just  discussed.  In  the  previous  example,  the  A 
matrix  was,  by  its  very  construction,  consistent,  i.e.,  every  row  of  A was 
some  multiple  of  the  first  row.  For  instance,  in  equation  (13),  row  2 
equalled  4/S  times  row  1,  row  3 equalled  2/S  times  row  1,  etc.  In  such  a case, 
the  rank  of  A is  one  (the  rank  of  a matrix  A is  the  order  of  the  largest 
square  sub-matrix  of  A whose  determinant  does  not  equal  zero).  Let  us  now 
determine  what  are  the  eigenvalues  of  a reciprocal  matrix  ' of  order  n and 
rank  one. 

It  is  well  known  that  the  expansion  of  (A  - \I)  yields  the  charac- 
teristic polynomial  f(\)  of  the  form: 

f(\)  = X"  + SjX'^"^  + Vl^  * ^ 

where 

s = (-o'"  times  the  sum  of  the  determinants  of  all  the  m-squarr  princi  • 
m 

pal  minors  of  A. 

But,  since  the  rank  of  A is  one,  the  determinants  ot  all  the  principal  minors 
of  A are  zero  for  ffl>l,  ns  well  ns  the  determinant  |a  I . The  only  non-zer: 
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determinants  are  those  of  order  one,  i.e.,  the  diagonal  elements  of  A which, 
in  a reciprocal  matrix,  are  all  one.  Hence,  = -n,  and: 

f(A)  = = A""^(A-n).  (16) 

The  eigenvalues  of  A are  obtained  as  usual  by  setting  f(A)  =0,  or  A = n and  0 
(with  multiplicity  n-1).  Then  A = n,  and  all  others  are  zero. 

fllAX 

It  is  also  well  known  that  the  trace  of  A (the  sum  of  the  diagonal 
elements  of  A)  equals  the  sum  of  the  eigenvalues.  But,  again,  these  diagonal 
elements  are  all  one;  hence,  A s a.  The  important  thing  to  note  is  that, 
if  A is  not  consistent  (i.e.,  if  the  rank  of  A is  greater  than  one),  A > n, 

iubX 

always , 

How  can  inconsistency  arise?  Suppose  that,  in  our  example,  the 
balance  scale  was  not  precise,  thus  producing  inexact  values  for  the  a^y  If 
the  imprecision  were  severe  enough,  then  the  transitivity  relationships: 
A^  > Aj  and  Aj  > Aj^  imply  > Aj^, 

may  not  hold  (where  A^  represents  the  ith  row  of  A).  That  imprecision  in  our 
weight  comparison  process  might  result,  say,  from  trying  to  estimate  the 
relative  weights  of  the  objects  by  balancing  them  in  our  hands  and  recording 
our  subjective  (hut  imprecise)  Judgments  as  to  '-'bich  is  heavier  and  in  what 
ratio.  We  can  snow  that  small  perturbations  in  the  result  in  only  small 
perturbations  in  The  next  questions  are:  what  is  the  impact  of  in- 

consistency upon  ordinal  ranking;  and  how  ran  we  measure  « :partures  from 
consistency? 

The  answer  to  the  first  question  is  that  ordinal  consistency  is 

preserved.  Saaty  shows  that  if  > ajj^  for  all  k,  then  w^  ^ even  if 

A > n. 
max 

In  answer  to  the  second  question,  Saaty  states  that  u = (A^  ^ -n)/ 

max 

(n-1)  is  a measure  of  inconsistency  and  is  related  to  the  statistical  root 
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mean  square  error.  He  observes  that  this  statistic  appears  to  follow  a 

probability  distribution*  whose  variance  is  twice  its  mean,  and  which  is 

2 

quite  similar  to  the  x distribution.  Without  knowing  the  distribution,  he 

suggests  using  the  ratio,  (x  - with  |J^  = 0,  i.e.,  x/(2x)  or  (x/2)  . 

This  quantitative  test  may  be  used  to  confirm  the  hypothesis  that  p = 0 when 

the  statistic  is,  say,  IS  1.  For  example,  in  a 6 x 6 reciprocal  matrix  suppose 

that  \ a 6.45.  Then  x = (6.45  - 6)/5  = 0.09.  The  test  statistic  is 
tnAx 

j. 

(x/2)^  a 0.21  < 1.  Hence,  we  may  conclude  in  this  case  that  the  departures 
from  technical  consistency  are  not  sufficient  to  invalidate  the  ordinal  rank- 
ing implied  by  the  resulting  eigenvector  w. 

What  are  the  implications  if  the  test  statistic  i 1?  First,  Saaty 
emphasizes  that  preference  or  importance  Judgements  need  not  be  transitive. 
He  illustrates  by  tournaments:  team  may  lose  to  team  C^,  which  has  lost  to 
team  C^;  yet  may  have  won  against  C^.  In  this  sense,  team  performance  may 
be  inconsistent.  Hence,  we  must  be  prepared  to  accept  some  inconsistency.  In 
fact,  the  arithmetical  properties  of  our  preference  scale  are  conducive  to 
generating  some  degree  of  inconsistency,  especially  with  large  preference 
matrices.  But,  in  general,  we  may  say  that,  whenever  the  test  statistic  i 1, 
it  should  be  regarded  as  a signal  to  reexamine  and  reevaluate  the  paired 
comparisons . 

With  this  understanding  of  pairwise  comparisons  and  eigenvalue 
analysis,  we  are  now  prepared  to  examine  the  concept  of  hierarchies  and  the 
application  of  eigenvalue  analysis  of  preference  at  successive  hierarchical 
levels . 

’“'Based  upon  experimental  results  derived  from  randomly  generated  re- 
ciprocal matrices. 
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HIERARCHICAL  DEVELOPMENT 


General 

Hierarchies  are  difficult  to  discuss  conceptually  without  resorting 
to  examples  or  fcrmalizing  their  properties  mathematically.  Examples,  how- 
ever, fail  to  provide  an  adequate  guide  for  construction  and  definition  of 
other  hierarchies,  and  presentation  of  the  mathematical  formulation  is  best 
deferred  until  we  have  an  intuitive  grasp  of  the  concept  of  hierarchy.  That 
formulation  shows  ordinal  preferences  to  be  preserved  throughout  the  levels  of 
a hierarchy  with  the  eigenvalue  technique.  This  result  means  we  can  use  the 
eigenvalue  technique  at  each  level  of  a hierarchy  and,  by  weighting  each 
successive  hierarchical  level  by  the  preference  vector  of  the  previous  level, 
generate  an  overall  preference  vector  at  the  lowest  level.  That  final  vector 
will  reflect  all  higher  level  ordinal  preferences. 

Eirat  of  all,  a hierarchy  is  a structure  of  various  elements, 
partitioned  into  levels.  These  levels  preserve  some  sense  of  order  or 
distinction,  as  perceived  by  the  person  performing  the  partitioning.  Each 
level  consists  of  elements  having  some  perceived  property  that  reflects  that 
order  or  distinction.  Conventionally,  the  first,  or  top,  level  is  one 
element,  sometimes  representing  what  in  set  theory  is  referred  to  as  the 
universe  of  discourse.  Successive  levels  may  represent  both  structural  and 
functional  relations,  and  their  elements  may  be  physical  entities  or 
activities,  possible  future  scenarios,  objectives,  policies,  etc. 

Saaty  sets  forth  three  substantive  properties  of  hierarchical 
structures; 

- They  usually  consist  of  a few  kinds  of  subsystems  in  various 
combinations  and  arrangements. 

- They  are  nearly  decomposable,  i.e.,  connections  between  levels 
are  far  simpler  and  more  distinctive  than  the  connections  between 
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elements  in  a level.  For  example,  one  level  might  consist  of 
objectives,  while  another  might  consist  of  activities.  The 
distinguishing  characteristics  between  objectives  and  activities 
are  much  more  obvious  than,  say,  the  distinctions  between  the 
elements  at  the  activity  level.  Hence,  the  aggregate  properties, 
which  first  defined  the  partitioning  of  the  levels,  determine  the 
interactions  between  levels,  and  not  the  properties  of  the 
individual  elements. 

*■  Regularities  in  the  interactions  between  levels  may  themselves  be 
classified  and  coded,  taking  advantage  of  redundancy  to  obtain 
greater  simplicity.  For  example,  the  change  in  a system  over 
time  may  be  described  by  a differential  equation  which  specifies 
the  amount  of  change  at  any  instant  of  time. 

Saaty  also  describes  five  advantages  of  hierarchies: 

- They  provide  a meaningful  integration  of  systems.  Thus,  the 
integrated  behavior  or  function  of  a hierarchical  organization 
accounts  for  the  fact  that  complicated  changes  in  a large  system 
can  result  in  a single  component,  contrary  to  what  we  generally 
expect . 

- They  use  aggregated  elements  in  the  form  of  levels  to  accomplish 
tasks . 

- Greater  detail  occurs  at  the  lower  levels  of  the  hierarchy,  while 
greater  understanding  of  its  purpose  occurs  at  the  higher  levels. 

- Hierarchies  are  efficient  and  will  evolve  In  natural  systems  much 
more  rapidly  than  non-hlerarchic  systems  with  the  same  number  of 
elements . 

- Hierarchies  are  reliable  and  flexible;  localized  perturbations  do 
not  perturb  the  entire  hierarchy,  The  overall  purpose  of  the 
hierarchy  is  partitioned  among  the  levels;  each  level  solves  a 
partial  problem,  and  the  totality  meets  the  overall  purpose. 

At  this  point,  having  presented  a generalized  concept  of  hier- 
archies, we  seek  to  outline  a method  for  constructing  them.  Unfortunately, 
there  seems  to  be  no  clear-cut,  detailed  method.  However,  we  can  derive  some 
insights  by  examining  two  fundamental  ways  in  which  the  idea  of  a hierarchy 
can  be  used. 

The  first  way  is  nothing  more  than  a hierarchical  modeling  of  the 
real  world.  The  second  way  is  probably  even  more  fundamental  and  points  up 
the  real  power  of  hierarchies;  breaking  things  down  into  large  groupings  or 
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clusters,  and  then  breaking  each  of  these  into  small  clusters,  and  so  on.  The 
object  would  then  be  to  obtain  the  priorities  of  all  the  elements  by  cluster- 
ing, a far  more  efficient  process  than  treating  all  the  elements  together. 

While  not  describing  a formal  approach  to  constructing  hierarchies, 
Saaty  does  outline  two  major  applic:ition  areas:  conflict  and  planning 
problems.  In  the  first,  he  describes  the  hierarchical  levels  as  representing 
the  actors  who  influence  or  control  the  conflict  outcome,  their  objectives , 
policies,  strategies . and  the  set  of  plausible  outcomes  that  may  result  from 
thtir  actions.  Eigenvalue  analysis  then  proouces  weights  or  priorities  for 
the  outcomes.  This  method  thus  provides  a basis  for  approaching  the  actors 
(or  the  parties  who  control  them)  as  to  what  may  work  best  when  their  combined 
interests  are  considered,  or  to  show  the'"  where  to  modify  their  positions  to 
achieve  a more  desirable  outcome. 

In  the  second  problem,  planning,  an  outcome  is  often  referred  to  as 
a scenario.  Saaty  asserts  that  these  scenarios  should  represent  "extremes"  t.i 
ensure  sufficient  richness  to  the  range  of  judgmental  preferences  for  those 
scenarios.  The  set  of  scenario  outcomes  is  then  hierarchically  weighted  by 
the  weights  of  the  actors  combined  with  the  weights  of  their  objectives,  and 
finally  with  those  of  their  strategies.  The  result  of  all  influences  on  the 
set  of  outcomes  is  a composite  outcome , the  likely  or  composite  future. 

This  composite  outcome  is  characterized  by  a set  of  state  va ciables , 
which  should  b:-  selected  so  that  their  values  describe  adequately  the  real 
world  modeled  by  the  hierarchy.  The  values  of  the  state  variables  are  cali- 
brated by  weighting  the  corresponding  values  of  the  variables  for  each 
scenario  considered.  The  values  assigned  to  the  state  variables  are  usually 
determined  by  a numerical  scale,  with  the  present  outcome  (or  status  quo) 
taken  as  the  zero  reference  point.  The  purpose  of  an  dialysis  such  as  this  is 
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to  examine  the  attitudes  of  the  actors  about  the  future  within  a uierarchical 
framework. 

The  application  of  eigenvalue  analysis  to  priorities  within  hier- 
archies draws  its  strength  from  the  decomposable  nature  of  hierarchies  them- 
selves. If  it  were  not  possible  to  conceive  of  and  generate  hierarchical 
levels,  each  consisting  of  a set  of  eleif<ents,  then  any  attempt  to  form  and 
quantify  judgmental  assessmeuts  between  and  among  al^  elements  would  face 
enormous  difficulties. 

For  example,  consider  a two-level  hierarchical  system  consisting  of 
activities  and  objectives . wherf  a subset  of  objectives  is  associated  with 
each  activity.  There  should  be  no  conceptual  problem  in  generating  a priority 
rdering  of  the  objectives  within  each  subset  with  eigenvalue  analysis.  Sub- 
sequently, each  of  the  prio/ity  ordering  vectors  can  be  weighted  by  the  re- 
lative priorities  assigned  to  each  activity,  resulting  in  a composite  weight- 
ing of  the  importance  of  each  objective. 

But  suppose  we  were  required  to  generate  a priority  ordering  of  all 
objectives  without  regard  to  the  activities  with  which  they  were  associated. 
We  would  be  forced  to  juggle  mentally  a multitude  of  factors  and  relationships 
to  arrive  at  each  pairwise  comparison.  It  would  be  well  nigh  impossible  to 
arrive  at  a consensus  as  to  the  impact  of  those  factors  and  relationships. 
The  use  of  hierarchies,  then,  permits  us  to  simplify  and  condense  those 
impacts  in  a piecemeal  fashion,  thus  restricting  them  to  those  necessary  to 
identify  direct  factors  and  relationships. 

Mathematical  Formulation 

The  purpose  of  the  following  discussion  is  to  derive  a formal  justi- 
fication for  the  matrix  multiplication  technique;  produce  a composite  priority 
or  preference  vector  at  any  hierarchical  level;  and  show  that  the  ordering  of 
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the  elements  of  that  vector  preserves  ordinal  preference  for  the  objects 
represented 

We  start  with  a number  of  definitions: 

1 . An  ordered  set  is  any  set  S with  a binary  relation  % which 
satisfies  these  laws: 

Reflexive:  For  all  x e S,  x S x 
Antisynoetric:  If  x i y and  y iS  x,  then  x - y 
Transitive:  If  x S y and  y ^z.  Then  x S z. 

2.  A simple  or  totally  ordered  set  (also  called  a chain)  is  an 
ordered  set  such  that  if  x,  y e S,  then  either  x S y or  y S x. 

Saaty  uses  the  notation  x~  = {y  x covers  y}  and  x^  = {y  y covers 
x}  for  any  element  x in  an  ordered  set  S.  The  element  x is  said  to  cover  (or 
dominate)  the  element  y if  x > y and  there  exists  no  t such  that  x > t > y. 

3.  Let  H be  a finite  partially  ordered  set  with  largest  element  b. 
H is  a hierarchy  if: 

a)  a partition  of  H into  sets  Lj^,  k=l,...,h,  where 


1 


= {b}; 


b)  ^ ^ implies  x 


k»l h-1;  and 


c)  X e implies  x ^h-1* 

Saaty  next  asserts  that,  for  each  x e H,  there  is  a suitable  weight- 


ing (or  priority)  function  w^^,  whose  nature  depends  upon  the  phenomenon  being 

hierarchically  structured,  and  which  maps  x into  the  interval  [0,1]  such  that 

Z '*5  (y)  = 1 
yex 

This  summation  reflects  the  normalization  procedure  discussed  earlier. 

We  may  think  of  the  sets  L,  as  the  levels  of  the  hierarchy,  and  w.. 

!L  ” 

as  the  priority  function  of  the  elements  in  one  level  with  respect  to  some 
objective  x.  Note  that,  even  if  x (for  some  k),  we  may  define  w^  for  all 

of  by  setting  it  equal  to  zero  for  all  elements  in  not  in  x . It  is 
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this  priority  functioo  that  permits  us  to  develop  this  important  appli- 
cation of  hierarchy  theory.  Another  definition: 

4.  H is  complete  if,  V x e Lj^,  ^ ~ 2,...,h. 

Now  we  state  the  basic  problem.  Given  any  element  x e L^,  and 

subsets  S C Lq,  with  a<^,  how  do  we  define  a function  w . that  maps  S into 
P 

the  interval  [0,1]  and  which  reflects  the  properties  of  the  priority  functions 
w on  the  levels  L.  , k s o(,  ...^-1?  Less  technically,  suppose  we  have  some 

y » 

structure  system  with  one  major  objective  or  goal  b,  and  a set  of  basic 

activities  within  that  system  such  that  the  whole  of  it  can  be  modeled  as  a 

hierarchy  (i.e.,  with  a largest  element  b and  lowest  level  Lj^).  Then  our 

present  structure  and  definitions  permit  us  to  determine  the  priorities  of  the 

elements  at  any  level  L^.  with  respect  to  some  element  (objective)  at  level 

L^_^.  How,  then,  do  we  determine  the  priorities  of  the  elements  of  with 

respect  to  b?  Saaty's  method  for  solving  this  basic  problem  follows. 

Assume  that  y = [y, } eL.  and  that  x = {x. ,...,x  ) 

^ “k  * ^ “k+1 

in  fact,  we  may  assume  that  Y = Lj^  and  X * by  setting  the  priority 

functions  at  each  level  equal  to  zero  for  those  elements  of  not  in  Y and  of 

not  in  X.  Note  that  n^  denotes  the  number  of  elements  in  L^.  Next,  we 

■assume  there  is  an  element  such  that  y C z-  Now  consider  the  priority 

functions  w , which  maps  Y into  the  interval  [0,1],  and  w , which  maps  X into 
z y 

[0,l].  Next,  construct  the  "priority  function  of  the  elements  in  X with 
respect  to  z,"  denoted  w,  such  that  X is  mapped  into  [0,1],  as  follows; 


“k 

w(x  ) = I w Cx  )•  w (y  ), 
^ j=l  ^j 


1 = 1,.  . . , n 


k+1 


(17) 


This  process  simply  weights  the  importance  (or  priority)  of  with  respect  to 
the  element  y^  by  multiplying  it  by  the  importance  of  y^^  with  respect  to  the 
element  z. 
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We  can  simplify  the  algorithmic  process  if  we  combine  the 


w (x.)  Into  a matrix  A by  setting  a..  - w (x.). 
y.  i ' ij  y.  i 

^1  J 

Also,  set  W.  = w(x.)  and  W, - = w (y.),  with  i=l,. 

1 1 J z j 

Then  (17)  becomes: 


Vi'  \- 


W,  s Z a.,  W'  , i=l,...,  n 

^ j=l  J 


k+l‘ 


(18) 


Now,  we  may  conceive  of  the  priority  vector 

W = (W. ) 

^ “^k+l 

and  of  the  priority  matrix  A,  and  formulate  (18)  as: 

W = AW', 

Saaty  summarizes  all  of  the  above  into  a principle  of  hierarchical 

composition.  Given  two  finite  sets  S and  T,  let  S be  a set  of  properties  and 

T,  a set  of  objects  having  those  properties  as  characteristics.  Assume  a 

priority  function  w.  > 0(j=l,...,  n)  for  each  s.  eS  such  that 
J J 

n 

Z w s 1, 

j=l  J 

and  assume  also  a priority  function  w^^  > 0 (i=l,...,  m)  for  each  t^  eT , 

relative  to  s , . Then  the  convex  combination  of  w . . , 

J 


J=r«  "r 


gives  the  numerical  priority  or  relative  importance  of  t^  with  respect  to  S. 
This  principle  can,  of  course,  be  generalized  to  a chain  of  sets. 

Now,  one  final  definition; 

5.  Suppose  that  for  each  subgoal  or  activity  in  there  is 
an  ordinal  scale  o^  over  the  activities  (of=l,..., 
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in  We  define  a partial  order  over  as  one  in  which 


i Cp  if  and  only  if  0^^  gOp^  for  n^^. 

With  the  following  two  theorems,  which  Saaty  presents  without  proof, 
we  validate  the  principle  of  hierarchical  conposition  by  showing  that  the 
ordinal  preferences  are  preserved  under  composition: 

Theorem  1 . Let  w . . = (w^  . , . . . , w . ) be  the  eigenvector  for 
^k+1  respect  to  Cj , and  assume  it  preserves 


the  order  of  the  o 


Let  W, W be  the 

“J  ^ k+1  ° 


composite  priority  vector  for  Lj^^j.  Then  i Cp  implies 

that  W ^ Wfl. 

“ P 

Theorem  2.  Let  H be  a complete  hierarchy  with  largest  element 

b and  with  h levels.  Let  be  the  priority  matrix 

of  the  kth  level,  k=2,...,  h.  If  W'  is  the  priority 

vector  of  the  pth  level  with  respect  to  some  element 

z in  the  (p  - l)st  level,  then  the  priority  vector  W 

of  the  qtb  level  (p<q)  with  respect  to  z is  given  by: 

W = A .A  . ,A  ^,W'.  (20) 

q q-1  p+l 

Thus,  the  priority  vector  of  the  lowest  level  with  respect  to  the  element  b is 
given  by: 

W = Ajj.Ajj_^.  . .A2W'.  (21) 

If  L^  has  but  a single  element,  as  has  been  our  convention,  then  W'  is  Just  a 
scalar;  otherwise,  it  is  a vector. 

The  consequence  of  these  two  theorems  is  to  Justify  the  matrix  multi- 
plicaton  technique  for  weighting  eigenvectors  by  showing  that  it  preserves 
ordinal  preferences  for  the  elements  at  the  lowest  hierarchic.il  level.  We 
believe  it  Important  to  mention  that  nothing  in  this  mathematical  formulation 
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imputes  meaning  to  the  difference  in  magnitude  between  the  numerical  prior- 
ities of  any  two  elements  in  a hierarchical  level:  i.e.,  w..  - w.,,  . = v > 0 
implies  only  that  the  priority  of  element  is  greater  than  that  of  element 
x^^^.  The  magnitude  of  y does  not  acquire  any  additional  ordinal  signifi- 
cance. However,  we  cannot  be  blamed  for  intuitively  attaching  more  signifi- 
cance to  the  priority  differences  of  three  objects  represented  by  a priority 
vector  such  as  (.75,  .15,  .10)  than  to  a vector  such  as  (.35,  .33,  .32). 

Likewise,  this  mathematical  formulation  contains  nothing  that  might 
rule  out  its  application  to  inconsistent  priority  matrices.  Nonetheless,  we 
still  need  to  address  the  problem  of  measuring  the  impact  of  such  inconsis- 
tency in  hierarchical  composition.  Saaty  asserts  that  such  a measure  has  the 

4 

same  format  as  (\  „“n)/(n-l),  discussed  earlier.  If  H is  a hierarchy  of  h 

iDaX 

levels  L^,  let  n^^  be  the  dimensionality  of  the  priority  matrix  with 
respect  to  the  jth  element  in  and  let  be  the  corresponding  eigen- 
value. Then  the  consistency  index  I is: 


- ^2 


n 

i=3 


“i-1 

Z 


A. 


ij 


h 

n 


isl 

z 


i=3  1=1 


‘ij 


S 0. 


(22) 
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Saaty  dues  not  indicate  the  probability  distribution  of  I;  most  likely,  that 

distribution  would  have  to  be  determined  experimentally. 

One  specific  advantage  of  Saaty' s preference  scale  not  addressed 

before  is  its  self-correcting  capability  relative  to  consistency.  In  matrix 

theory  it  is  known  that  the  eigenvalues  are  continuous  functions  of  the  matrix 

coefficients  (a^^).  If  we  perturb  the  coefficients  of  a consistent  matrix, 

A will  remain  close  to  n,  while  the  n-1  other  eigenvalues  will  remain  close 
max  ® 


A-21 


to  zero.  It  is  also  knovm  that  \ is  a moaotonic  increasias  fimction  of 

max 

Hence,  in  a reciprocal  matrix  engendered  by  the  use  of  that  preference 
scale,  a deviation  (increase)  in  \ , induced  by  a departure  from  consistency 

ffidX 

in  , is  compensated  for  by  a reduction  induced  by  • 
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